Jul 02 12:38:49.154685 ip-10-0-128-177 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 12:38:49.559163 ip-10-0-128-177 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 12:38:49.559163 ip-10-0-128-177 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 12:38:49.559163 ip-10-0-128-177 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 12:38:49.559163 ip-10-0-128-177 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 12:38:49.559163 ip-10-0-128-177 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 12:38:49.563057 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.562989    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 12:38:49.566477 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566464    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 12:38:49.566477 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566477    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566481    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566484    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566488    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566491    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566499    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566502    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566504    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566507    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566509    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566512    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566515    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566517    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566520    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566522    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566525    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566528    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566530    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566533    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566535    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 12:38:49.566543 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566538    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566541    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566544    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566547    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566549    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566553    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566555    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566558    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566560    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566563    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566565    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566568    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566571    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566573    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566575    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566578    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566581    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566583    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566586    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566588    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 12:38:49.567025 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566591    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566593    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566596    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566598    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566602    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566605    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566609    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566611    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566614    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566616    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566619    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566623    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566626    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566629    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566633    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566636    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566639    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566641    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566644    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 12:38:49.567509 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566646    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566649    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566651    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566654    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566657    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566659    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566662    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566665    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566667    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566670    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566673    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566675    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566678    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566680    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566683    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566686    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566692    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566695    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566697    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 12:38:49.567978 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566700    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566703    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566705    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566708    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566710    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566713    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566715    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566718    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566722    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566724    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566727    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566730    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566732    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566735    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566737    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566740    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566742    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566744    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566747    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.566750    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 12:38:49.568453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567416    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567423    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567425    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567443    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567447    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567450    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567454    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567457    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567459    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567462    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567465    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567468    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567470    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567473    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567475    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567478    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567481    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567483    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567486    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567489    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 12:38:49.568946 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567492    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567494    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567497    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567499    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567502    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567505    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567507    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567510    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567512    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567515    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567517    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567521    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567523    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567526    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567528    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567531    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567534    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567537    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567539    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567542    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 12:38:49.569453 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567545    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567547    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567550    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567552    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567555    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567557    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567560    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567562    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567565    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567567    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567570    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567592    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567611    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567615    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567619    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567622    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567625    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567628    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567631    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567635    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 12:38:49.569951 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567637    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567640    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567644    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567647    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567650    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567652    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567655    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567657    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567660    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567663    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567665    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567668    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567670    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567673    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567677    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567682    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567685    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567688    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567691    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 12:38:49.570449 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567694    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567696    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567699    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567701    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567704    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567708    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567711    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567714    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567718    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567722    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567725    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567728    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567731    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567734    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567736    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567740    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567744    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567747    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567749    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 12:38:49.570956 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.567752    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568113    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568118    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568121    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568124    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568127    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568129    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568132    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568134    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568137    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568139    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568142    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568146    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568150    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568153    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568156    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568159    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568161    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568165    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568168    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 12:38:49.571423 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568171    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568173    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568176    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568178    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568181    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568183    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568186    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568188    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568191    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568193    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568196    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568198    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568200    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568203    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568205    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568208    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568210    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568213    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568215    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568218    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 12:38:49.571963 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568220    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568223    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568225    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568227    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568230    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568232    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568235    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568237    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568240    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568242    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568250    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568253    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568255    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568258    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568260    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568263    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568265    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568268    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568270    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568273    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 12:38:49.572466 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568275    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568278    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568280    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568283    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568285    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568288    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568290    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568293    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568296    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568298    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568303    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568306    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568309    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568312    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568314    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568317    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568319    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568323    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568326    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 12:38:49.572960 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568330    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568333    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568336    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568339    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568342    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568350    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568353    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568355    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568358    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568360    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568363    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568366    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568368    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568371    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568373    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568376    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568379    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568381    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568383    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568386    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.568388    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 12:38:49.573481 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568464    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568471    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568477    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568482    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568486    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568489    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568493    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568496    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568500    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568503    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568506    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568510    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568514    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568517    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568521    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568524    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568527    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568531    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568535    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568538    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568541    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568544    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568547    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568551    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 12:38:49.573981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568554    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568557    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568560    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568563    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568566    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568569    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568572    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568575    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568579    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568587    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568590    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568593    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568596    2560 flags.go:64] FLAG: --enable-server="true"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568598    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568603    2560 flags.go:64] FLAG: --event-burst="100"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568606    2560 flags.go:64] FLAG: --event-qps="50"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568609    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568612    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568614    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568618    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568621    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568624    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568629    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568632    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568635    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 12:38:49.574573 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568638    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568641    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568645    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568648    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568650    2560 flags.go:64] FLAG: --feature-gates=""
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568654    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568657    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568660    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568663    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568666    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568669    2560 flags.go:64] FLAG: --help="false"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568672    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568675    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568678    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568681    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568684    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568687    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568690    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568693    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568696    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568698    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568701    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568704    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568707    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 02 12:38:49.575234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568710    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568712    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568715    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568718    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568721    2560 flags.go:64] FLAG: --lock-file=""
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568725    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568728    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568731    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568736    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568739    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568742    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568745    2560 flags.go:64] FLAG: --logging-format="text"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568748    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568751    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568753    2560 flags.go:64] FLAG: --manifest-url=""
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568756    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568760    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568763    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568769    2560 flags.go:64] FLAG: --max-pods="110"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568772    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568775    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568778    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568781    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568784    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568786    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 12:38:49.575829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568790    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568796    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568799    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568802    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568805    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568807    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568812    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568815    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568818    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568821    2560 flags.go:64] FLAG: --port="10250"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568824    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568827    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b91f035f8c7ec19e"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568832    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568835    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568838    2560 flags.go:64] FLAG: --register-node="true"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568840    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568844    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568847    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568850    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568853    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568856    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568860    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568863    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568865    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568868    2560 flags.go:64] FLAG: --runonce="false"
Jul 02 12:38:49.576451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568871    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568874    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568876    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568879    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568882    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568885    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568888    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568890    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568893    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568896    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568899    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568901    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568904    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568907    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568910    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568915    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568918    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568923    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568926    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568931    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568933    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568936    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568939    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568942    2560 flags.go:64] FLAG: --v="2"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568945    2560 flags.go:64] FLAG: --version="false"
Jul 02 12:38:49.577082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568949    2560 flags.go:64] FLAG: --vmodule=""
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568953    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.568957    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569057    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569062    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569065    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569069    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569072    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569075    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569078    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569080    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569083    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569086    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569089    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569092    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569094    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569097    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569100    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569102    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 12:38:49.577723 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569105    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569107    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569109    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569112    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569114    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569118    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569120    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569124    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569126    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569129    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569132    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569134    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569137    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569139    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569143    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569147    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569150    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569152    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569155    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 12:38:49.578189 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569158    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569161    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569164    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569166    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569169    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569171    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569174    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569176    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569179    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569181    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569184    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569186    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569188    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569191    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569193    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569196    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569200    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569203    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569206    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 12:38:49.578746 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569209    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569214    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569217    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569220    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569222    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569225    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569228    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569230    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569233    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569235    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569238    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569241    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569243    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569246    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569249    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569251    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569254    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569256    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569259    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569261    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 12:38:49.579542 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569264    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569266    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569269    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569271    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569273    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569276    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569278    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569281    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569283    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569285    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569288    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569292    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569294    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569298    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569301    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569303    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569306    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569309    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569311    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569314    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 12:38:49.580231 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569316    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569318    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569321    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569324    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.569326    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.570236    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.576231    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.576243    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.576831    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.576838    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576906    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576912    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576915    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576918    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576921    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 12:38:49.580759 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576924    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576927    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576930    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576933    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576936    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576939    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576941    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576944    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576946    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576949    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576952    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576956    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576960    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576962    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576965    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576967    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576970    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576973    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576975    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576978    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 12:38:49.581170 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576980    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576982    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576985    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576987    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576991    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576993    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.576996    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577000    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577004    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577007    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577009    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577012    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577015    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577017    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577020    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577022    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577025    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577028    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577030    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 12:38:49.581763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577033    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577035    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577038    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577040    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577043    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577045    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577048    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577051    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577053    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577056    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577058    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577061    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577063    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577066    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577068    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577071    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577073    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577077    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577079    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577082    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 12:38:49.582238 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577085    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577088    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577091    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577093    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577096    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577100    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577103    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577106    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577109    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577112    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577115    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577118    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577120    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577123    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577126    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577128    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577131    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577133    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577135    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577138    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 12:38:49.582752 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577140    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577143    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577145    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577147    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577150    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577152    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577155    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577157    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577160    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577163    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577166    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577169    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577171    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577174    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577177    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 12:38:49.583344 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.577181    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577281    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577285    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577288    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577291    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577294    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577297    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577299    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577301    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577305    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577309    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577312    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577314    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577317    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577319    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577322    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577324    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577327    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577329    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577332    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 12:38:49.583726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577335    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577338    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577340    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577343    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577345    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577348    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577350    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577353    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577355    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577358    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577360    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577363    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577365    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577368    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577370    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577373    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577375    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577377    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577380    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577382    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 12:38:49.584235 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577385    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577387    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577390    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577392    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577395    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577397    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577399    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577402    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577405    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577407    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577409    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577412    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577415    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577417    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577419    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577422    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577424    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577427    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577444    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577449    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 12:38:49.584812 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577453    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577457    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577460    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577463    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577465    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577467    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577470    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577473    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577475    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577477    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577481    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577485    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577487    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577490    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577493    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577496    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577499    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577501    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577504    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 12:38:49.585651 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577506    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577508    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577511    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577513    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577516    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577518    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577521    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577523    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577526    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577528    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577531    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577533    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577535    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577538    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577540    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577543    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577545    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577548    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577551    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577554    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 12:38:49.586300 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:49.577557    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 12:38:49.586816 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.577562    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 12:38:49.586816 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.577652    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 12:38:49.586816 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.581231    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 12:38:49.586816 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.582679    2560 server.go:1019] "Starting client certificate rotation"
Jul 02 12:38:49.586816 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.582793    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 12:38:49.586816 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.582842    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 12:38:49.586816 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.585330    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 12:38:49.589617 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.589599    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 12:38:49.600423 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.600408    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 02 12:38:49.602639 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.602626    2560 log.go:25] "Validated CRI v1 image API"
Jul 02 12:38:49.603395 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.603381    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 12:38:49.605783 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.605762    2560 fs.go:135] Filesystem UUIDs: map[1e29595c-85bf-46d4-a0bf-f26fd219835b:/dev/nvme0n1p4 27bc4bb5-7930-41ad-96c0-578f675b4f6a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 02 12:38:49.605836 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.605784    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 12:38:49.611592 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.611482    2560 manager.go:216] Machine: {Timestamp:2026-07-02 12:38:49.609195438 +0000 UTC m=+0.341455838 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108903 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f88367f8492afca3555dfb33309d9 SystemUUID:ec2f8836-7f84-92af-ca35-55dfb33309d9 BootID:9a8eb565-50f1-4d8c-8519-b1e656f5cd87 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2b:5a:62:cf:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2b:5a:62:cf:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:ad:b2:c1:c5:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 12:38:49.611592 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.611585    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 12:38:49.611751 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.611653    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 12:38:49.612761 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.612742    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 12:38:49.612892 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.612763    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 12:38:49.613508 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.613498    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 12:38:49.613546 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.613510    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 12:38:49.613546 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.613518    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 12:38:49.614171 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.614161    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 12:38:49.614527 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.614510    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 12:38:49.616985 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.616973    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 12:38:49.620076 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.620064    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 12:38:49.620207 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.620198    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 12:38:49.620235 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.620225    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 12:38:49.620235 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.620234    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 12:38:49.620285 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.620247    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 12:38:49.620285 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.620256    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 02 12:38:49.620285 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.620264    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 12:38:49.621244 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.621232    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 12:38:49.621295 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.621253    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 12:38:49.624265 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.624224    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 12:38:49.626034 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626017    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 12:38:49.626097 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626048    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 12:38:49.626688 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626678    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 12:38:49.626721 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626693    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 12:38:49.626721 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626699    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 12:38:49.626721 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626704    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 12:38:49.626721 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626713    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 12:38:49.626827 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626722    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 12:38:49.626827 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626811    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 12:38:49.626827 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626817    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 12:38:49.626827 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626824    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 12:38:49.626941 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626829    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 12:38:49.626941 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626837    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 12:38:49.626941 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.626845    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 12:38:49.628503 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.628494    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 12:38:49.628503 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.628503    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 12:38:49.631390 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.631375    2560 server.go:1268] "Started kubelet"
Jul 02 12:38:49.631520 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.631456    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 12:38:49.631520 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.631492    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 12:38:49.631632 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.631554    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 12:38:49.631809 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.631792    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 12:38:49.632138 ip-10-0-128-177 systemd[1]: Started Kubernetes Kubelet.
Jul 02 12:38:49.632605 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.632575    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 12:38:49.632605 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.632572    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 12:38:49.633004 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.632990    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 12:38:49.633772 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.633755    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 12:38:49.635786 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.635768    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 12:38:49.636892 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.636879    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lj4nv"
Jul 02 12:38:49.638375 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.637505    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-177.ec2.internal.18be7959eda4d1cf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-177.ec2.internal,UID:ip-10-0-128-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-177.ec2.internal,},FirstTimestamp:2026-07-02 12:38:49.631347151 +0000 UTC m=+0.363607551,LastTimestamp:2026-07-02 12:38:49.631347151 +0000 UTC m=+0.363607551,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-177.ec2.internal,}"
Jul 02 12:38:49.640179 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.640165    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 12:38:49.640179 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.640175    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 12:38:49.640297 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.640280    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 02 12:38:49.641126 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.641110    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 12:38:49.641126 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.641119    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 12:38:49.641250 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.641137    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 12:38:49.641250 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.641209    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 12:38:49.641250 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.641217    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 12:38:49.642353 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.642337    2560 factory.go:55] Registering systemd factory
Jul 02 12:38:49.642353 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.642354    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 02 12:38:49.642577 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.642565    2560 factory.go:153] Registering CRI-O factory
Jul 02 12:38:49.642577 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.642579    2560 factory.go:223] Registration of the crio container factory successfully
Jul 02 12:38:49.642637 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.642625    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 12:38:49.642680 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.642642    2560 factory.go:103] Registering Raw factory
Jul 02 12:38:49.642680 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.642651    2560 manager.go:1196] Started watching for new ooms in manager
Jul 02 12:38:49.643142 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.643126    2560 manager.go:349] Starting recovery of all containers
Jul 02 12:38:49.644978 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.644961    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lj4nv"
Jul 02 12:38:49.647497 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.647461    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 12:38:49.647662 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.647640    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 12:38:49.654025 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.654001    2560 manager.go:354] Recovery completed
Jul 02 12:38:49.659791 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.659779    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 12:38:49.662028 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.662009    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 12:38:49.662090 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.662034    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 12:38:49.662090 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.662043    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 02 12:38:49.662501 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.662487    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 12:38:49.662501 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.662499    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 12:38:49.662618 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.662489    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 12:38:49.662618 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.662513    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 12:38:49.663784 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.663770    2560 policy_none.go:49] "None policy: Start"
Jul 02 12:38:49.663880 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.663786    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 12:38:49.663880 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.663799    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 12:38:49.663994 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.663942    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 12:38:49.663994 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.663976    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 12:38:49.663994 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.663992    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 02 12:38:49.664084 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.664007    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-177.ec2.internal.18be7959ef78de7a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-177.ec2.internal,UID:ip-10-0-128-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-177.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-177.ec2.internal,},FirstTimestamp:2026-07-02 12:38:49.662021242 +0000 UTC m=+0.394281642,LastTimestamp:2026-07-02 12:38:49.662021242 +0000 UTC m=+0.394281642,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-177.ec2.internal,}"
Jul 02 12:38:49.665111 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.665099    2560 policy_none.go:47] "Start"
Jul 02 12:38:49.706171 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.698987    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 12:38:49.706171 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.700055    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 12:38:49.706171 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.700085    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 12:38:49.706171 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.700109    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 12:38:49.706171 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.700137    2560 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 02 12:38:49.706171 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.701737    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 12:38:49.706977 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.706964    2560 manager.go:337] "Starting Device Plugin manager"
Jul 02 12:38:49.707040 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.706995    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 12:38:49.707040 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.707003    2560 server.go:87] "Starting device plugin registration server"
Jul 02 12:38:49.707210 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.707197    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 12:38:49.707253 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.707213    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 12:38:49.707329 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.707313    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 12:38:49.707406 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.707396    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 12:38:49.707471 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.707408    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 12:38:49.707826 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.707807    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 12:38:49.707884 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.707860    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 02 12:38:49.801154 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.801035    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"]
Jul 02 12:38:49.801225 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.801185    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 12:38:49.801906 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.801893    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 12:38:49.801966 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.801918    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 12:38:49.801966 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.801931    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 02 12:38:49.803511 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.803497    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 12:38:49.803639 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.803614    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.803677 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.803654    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 12:38:49.804148 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.804132    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 12:38:49.804148 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.804140    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 12:38:49.804268 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.804161    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 12:38:49.804268 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.804164    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 12:38:49.804268 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.804172    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 02 12:38:49.804268 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.804178    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 02 12:38:49.805388 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.805373    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.805467 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.805406    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 12:38:49.806030 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.806011    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 12:38:49.806109 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.806041    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 12:38:49.806109 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.806057    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 02 12:38:49.808085 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.808071    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 12:38:49.808720 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.808706    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 12:38:49.808802 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.808724    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 12:38:49.808802 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.808733    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeHasSufficientPID"
Jul 02 12:38:49.808802 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.808749    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.814468 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.814455    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.814536 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.814472    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-177.ec2.internal\": node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 02 12:38:49.831720 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.831705    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 02 12:38:49.838971 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.838952    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-177.ec2.internal\" not found" node="ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.842047 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.842028    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5fb27810fb6dc0f9781a737032e64eed-config\") pod \"kube-apiserver-proxy-ip-10-0-128-177.ec2.internal\" (UID: \"5fb27810fb6dc0f9781a737032e64eed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.842122 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.842050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b8fda05825405a6c05553e16605a4784-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"b8fda05825405a6c05553e16605a4784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.842122 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.842067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8fda05825405a6c05553e16605a4784-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"b8fda05825405a6c05553e16605a4784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.843324 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.843308    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-177.ec2.internal\" not found" node="ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.932795 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:49.932771    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 02 12:38:49.942826 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.942800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b8fda05825405a6c05553e16605a4784-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"b8fda05825405a6c05553e16605a4784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.942826 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.942830    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8fda05825405a6c05553e16605a4784-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"b8fda05825405a6c05553e16605a4784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.942927 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.942845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5fb27810fb6dc0f9781a737032e64eed-config\") pod \"kube-apiserver-proxy-ip-10-0-128-177.ec2.internal\" (UID: \"5fb27810fb6dc0f9781a737032e64eed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.942927 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.942870    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5fb27810fb6dc0f9781a737032e64eed-config\") pod \"kube-apiserver-proxy-ip-10-0-128-177.ec2.internal\" (UID: \"5fb27810fb6dc0f9781a737032e64eed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.942927 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.942892    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b8fda05825405a6c05553e16605a4784-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"b8fda05825405a6c05553e16605a4784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:49.942927 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:49.942907    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8fda05825405a6c05553e16605a4784-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal\" (UID: \"b8fda05825405a6c05553e16605a4784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:50.033445 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.033415    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 02 12:38:50.134173 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.134156    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 02 12:38:50.142379 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.142364    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:50.147485 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.147472    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:50.234740 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.234717    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 02 12:38:50.335249 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.335227    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 02 12:38:50.435719 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.435676    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-177.ec2.internal\" not found"
Jul 02 12:38:50.484588 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.484567    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 12:38:50.540290 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.540270    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:50.550469 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.550453    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 12:38:50.552568 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.552554    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal"
Jul 02 12:38:50.560319 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.560302    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 12:38:50.582483 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.582464    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 12:38:50.582629 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.582608    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 12:38:50.582703 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.582649    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 12:38:50.620766 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.620748    2560 apiserver.go:52] "Watching apiserver"
Jul 02 12:38:50.632156 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:50.632134    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8fda05825405a6c05553e16605a4784.slice/crio-246a19064d65df213546ba0bc25a62db0ffa6eafb2a4c85d09712d5aaa18f37f WatchSource:0}: Error finding container 246a19064d65df213546ba0bc25a62db0ffa6eafb2a4c85d09712d5aaa18f37f: Status 404 returned error can't find the container with id 246a19064d65df213546ba0bc25a62db0ffa6eafb2a4c85d09712d5aaa18f37f
Jul 02 12:38:50.632615 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:50.632600    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb27810fb6dc0f9781a737032e64eed.slice/crio-023efbc2d77fde7556d360e3373674688f329c333168c54daa1a0288faf7c69e WatchSource:0}: Error finding container 023efbc2d77fde7556d360e3373674688f329c333168c54daa1a0288faf7c69e: Status 404 returned error can't find the container with id 023efbc2d77fde7556d360e3373674688f329c333168c54daa1a0288faf7c69e
Jul 02 12:38:50.637619 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.637602    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 12:38:50.637844 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.637830    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 12:38:50.638202 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.638180    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-tq8xq","openshift-multus/multus-jl58l","openshift-multus/network-metrics-daemon-srq4r","openshift-ovn-kubernetes/ovnkube-node-sv8zr","kube-system/global-pull-secret-syncer-sw5dm","kube-system/konnectivity-agent-9rklj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j","openshift-dns/node-resolver-drc6k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal","openshift-multus/multus-additional-cni-plugins-s228p","openshift-network-diagnostics/network-check-target-dhszc","openshift-network-operator/iptables-alerter-rwsc6","kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qbqgv"]
Jul 02 12:38:50.640286 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.640252    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tq8xq"
Jul 02 12:38:50.640511 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.640470    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 12:38:50.642081 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.642057    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.643505 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.643465    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:50.643605 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.643592    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 12:38:50.643850 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.643584    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:38:50.643935 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.643864    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 12:38:50.643935 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.643903    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vxb59\""
Jul 02 12:38:50.644033 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.643961    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 12:38:50.644905 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.644887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.644998 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.644986    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5l9w4\""
Jul 02 12:38:50.645469 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645453    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 12:38:50.645564 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645516    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 12:38:50.645564 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645522    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 12:38:50.645564 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645536    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 12:38:50.645773 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645757    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-cnibin\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.645819 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-cni-binary-copy\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.645852 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-run-multus-certs\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.645892 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca69c8d9-e134-41f9-98fb-52721bed505f-host\") pod \"node-ca-tq8xq\" (UID: \"ca69c8d9-e134-41f9-98fb-52721bed505f\") " pod="openshift-image-registry/node-ca-tq8xq"
Jul 02 12:38:50.645892 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgtql\" (UniqueName: \"kubernetes.io/projected/ca69c8d9-e134-41f9-98fb-52721bed505f-kube-api-access-xgtql\") pod \"node-ca-tq8xq\" (UID: \"ca69c8d9-e134-41f9-98fb-52721bed505f\") " pod="openshift-image-registry/node-ca-tq8xq"
Jul 02 12:38:50.645989 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-system-cni-dir\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.645989 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-os-release\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.645989 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-daemon-config\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.645989 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.645986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-socket-dir-parent\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.646172 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-var-lib-cni-bin\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.646172 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-var-lib-cni-multus\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.646172 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca69c8d9-e134-41f9-98fb-52721bed505f-serviceca\") pod \"node-ca-tq8xq\" (UID: \"ca69c8d9-e134-41f9-98fb-52721bed505f\") " pod="openshift-image-registry/node-ca-tq8xq"
Jul 02 12:38:50.646172 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-cni-dir\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.646172 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-run-k8s-cni-cncf-io\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.646398 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-run-netns\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.646398 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-var-lib-kubelet\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.646398 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646221    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-hostroot\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.646398 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646244    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-conf-dir\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.646398 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-etc-kubernetes\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.646398 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vp99\" (UniqueName: \"kubernetes.io/projected/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-kube-api-access-5vp99\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.646692 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.646511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:50.646692 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.646567    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:38:50.647530 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.647515    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 12:38:50.647960 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.647947    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:38:50.648772 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.648754    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 12:38:50.648772 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.648770    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 12:38:50.648889 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.648774    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 12:33:49 +0000 UTC" deadline="2028-04-15 02:45:57.234092848 +0000 UTC"
Jul 02 12:38:50.648889 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.648824    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15662h7m6.585272003s"
Jul 02 12:38:50.649081 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.649016    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 12:38:50.649081 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.649036    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mbxq9\""
Jul 02 12:38:50.649081 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.649075    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 12:38:50.649262 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.649086    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 12:38:50.649620 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.649606    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.650395 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.650200    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 12:38:50.650395 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.650261    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rvv7k\""
Jul 02 12:38:50.650610 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.650594    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 12:38:50.650981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.650967    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-drc6k"
Jul 02 12:38:50.652878 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.652681    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 12:38:50.652878 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.652724    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.652878 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.652754    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 12:38:50.652878 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.652773    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-66sh9\""
Jul 02 12:38:50.652878 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.652790    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 12:38:50.653876 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.653858    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 12:38:50.653967 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.653930    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kr8v8\""
Jul 02 12:38:50.653967 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.653935    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 12:38:50.654616 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.654601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:38:50.654703 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.654660    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:38:50.655102 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.654965    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 12:38:50.655315 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.655295    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 12:38:50.655411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.655394    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d5chc\""
Jul 02 12:38:50.655629 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.655615    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 12:38:50.656281 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.656264    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rwsc6"
Jul 02 12:38:50.657645 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.657633    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.658652 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.658638    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 12:38:50.658909 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.658884    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 12:38:50.658991 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.658909    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ngzpz\""
Jul 02 12:38:50.659595 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.659581    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 12:38:50.660014 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.659993    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 12:38:50.660119 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.660106    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 12:38:50.660303 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.660290    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p44xz\""
Jul 02 12:38:50.676235 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.676220    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rvtsm"
Jul 02 12:38:50.683535 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.683518    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rvtsm"
Jul 02 12:38:50.703548 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.703515    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" event={"ID":"b8fda05825405a6c05553e16605a4784","Type":"ContainerStarted","Data":"246a19064d65df213546ba0bc25a62db0ffa6eafb2a4c85d09712d5aaa18f37f"}
Jul 02 12:38:50.704376 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.704361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" event={"ID":"5fb27810fb6dc0f9781a737032e64eed","Type":"ContainerStarted","Data":"023efbc2d77fde7556d360e3373674688f329c333168c54daa1a0288faf7c69e"}
Jul 02 12:38:50.742079 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.742061    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 12:38:50.746837 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.746821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmrm6\" (UniqueName: \"kubernetes.io/projected/1718a22e-65f2-4062-9425-ec7266e9d552-kube-api-access-rmrm6\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.746899 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.746845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-kubernetes\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.746899 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.746860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-socket-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.746899 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.746874    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:50.747045 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.746899    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead7f268-0162-428f-9cf4-f72141d2c2f3-tmp-dir\") pod \"node-resolver-drc6k\" (UID: \"ead7f268-0162-428f-9cf4-f72141d2c2f3\") " pod="openshift-dns/node-resolver-drc6k"
Jul 02 12:38:50.747045 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.746936    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-slash\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.747045 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.746976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-cni-binary-copy\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.747045 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-var-lib-cni-multus\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.747045 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m7bg\" (UniqueName: \"kubernetes.io/projected/ead7f268-0162-428f-9cf4-f72141d2c2f3-kube-api-access-4m7bg\") pod \"node-resolver-drc6k\" (UID: \"ead7f268-0162-428f-9cf4-f72141d2c2f3\") " pod="openshift-dns/node-resolver-drc6k"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747054    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-etc-openvswitch\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-run-openvswitch\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747087    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-var-lib-cni-multus\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747106    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2cf6e252-53bd-4150-af7b-0bd18556f36a-env-overrides\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747131    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cef66cb7-ba61-4dc2-ace0-a2b3558bbb37-host-slash\") pod \"iptables-alerter-rwsc6\" (UID: \"cef66cb7-ba61-4dc2-ace0-a2b3558bbb37\") " pod="openshift-network-operator/iptables-alerter-rwsc6"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-cni-dir\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747177    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-run-netns\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca69c8d9-e134-41f9-98fb-52721bed505f-host\") pod \"node-ca-tq8xq\" (UID: \"ca69c8d9-e134-41f9-98fb-52721bed505f\") " pod="openshift-image-registry/node-ca-tq8xq"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2cf6e252-53bd-4150-af7b-0bd18556f36a-ovnkube-script-lib\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747259    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca69c8d9-e134-41f9-98fb-52721bed505f-host\") pod \"node-ca-tq8xq\" (UID: \"ca69c8d9-e134-41f9-98fb-52721bed505f\") " pod="openshift-image-registry/node-ca-tq8xq"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747257    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-run-netns\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.747316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-sysctl-conf\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747345    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-sys\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747377    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-cni-bin\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72lmb\" (UniqueName: \"kubernetes.io/projected/2cf6e252-53bd-4150-af7b-0bd18556f36a-kube-api-access-72lmb\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747415    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-cni-dir\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-var-lib-kubelet\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-os-release\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-daemon-config\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747502    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-log-socket\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llh2d\" (UniqueName: \"kubernetes.io/projected/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-kube-api-access-llh2d\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-sysctl-d\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-lib-modules\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747604    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2cf6e252-53bd-4150-af7b-0bd18556f36a-ovn-node-metrics-cert\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747612    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-os-release\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-var-lib-cni-bin\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba57525a-aa69-48d0-a51b-d631b1fde187-kubelet-config\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:50.747767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba57525a-aa69-48d0-a51b-d631b1fde187-dbus\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747674    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-var-lib-cni-bin\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed9ea745-2599-4556-8d74-f24466245547-konnectivity-ca\") pod \"konnectivity-agent-9rklj\" (UID: \"ed9ea745-2599-4556-8d74-f24466245547\") " pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-var-lib-kubelet\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-hostroot\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-conf-dir\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747791    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-conf-dir\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-etc-kubernetes\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747803    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-hostroot\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747811    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-var-lib-kubelet\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ead7f268-0162-428f-9cf4-f72141d2c2f3-hosts-file\") pod \"node-resolver-drc6k\" (UID: \"ead7f268-0162-428f-9cf4-f72141d2c2f3\") " pod="openshift-dns/node-resolver-drc6k"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747855    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-etc-kubernetes\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-run-netns\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cef66cb7-ba61-4dc2-ace0-a2b3558bbb37-iptables-alerter-script\") pod \"iptables-alerter-rwsc6\" (UID: \"cef66cb7-ba61-4dc2-ace0-a2b3558bbb37\") " pod="openshift-network-operator/iptables-alerter-rwsc6"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-tuned\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747927    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747936    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-daemon-config\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-cni-binary-copy\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.748427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.747986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-run-multus-certs\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgtql\" (UniqueName: \"kubernetes.io/projected/ca69c8d9-e134-41f9-98fb-52721bed505f-kube-api-access-xgtql\") pod \"node-ca-tq8xq\" (UID: \"ca69c8d9-e134-41f9-98fb-52721bed505f\") " pod="openshift-image-registry/node-ca-tq8xq"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748053    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-run-multus-certs\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzm5w\" (UniqueName: \"kubernetes.io/projected/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-kube-api-access-dzm5w\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-run-systemd\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-run-ovn\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748200    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-modprobe-d\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-system-cni-dir\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnxh9\" (UniqueName: \"kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9\") pod \"network-check-target-dhszc\" (UID: \"a40b3102-c663-4d18-b41b-84c6ae90d57c\") " pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-run\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748317    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-system-cni-dir\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748320    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-cni-binary-copy\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748337    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-os-release\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748377    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-tmp\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vp99\" (UniqueName: \"kubernetes.io/projected/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-kube-api-access-5vp99\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-cnibin\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.749180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748483    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-cnibin\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w2cn\" (UniqueName: \"kubernetes.io/projected/cef66cb7-ba61-4dc2-ace0-a2b3558bbb37-kube-api-access-5w2cn\") pod \"iptables-alerter-rwsc6\" (UID: \"cef66cb7-ba61-4dc2-ace0-a2b3558bbb37\") " pod="openshift-network-operator/iptables-alerter-rwsc6"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748516    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-systemd\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-cnibin\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748565    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-host\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748602    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-socket-dir-parent\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca69c8d9-e134-41f9-98fb-52721bed505f-serviceca\") pod \"node-ca-tq8xq\" (UID: \"ca69c8d9-e134-41f9-98fb-52721bed505f\") " pod="openshift-image-registry/node-ca-tq8xq"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-var-lib-openvswitch\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-device-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748742    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-multus-socket-dir-parent\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748779    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-sys-fs\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8vwx\" (UniqueName: \"kubernetes.io/projected/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-kube-api-access-q8vwx\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748810    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-run-ovn-kubernetes\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2cf6e252-53bd-4150-af7b-0bd18556f36a-ovnkube-config\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-run-k8s-cni-cncf-io\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.749672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed9ea745-2599-4556-8d74-f24466245547-agent-certs\") pod \"konnectivity-agent-9rklj\" (UID: \"ed9ea745-2599-4556-8d74-f24466245547\") " pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:38:50.750154 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-kubelet\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.750154 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748937    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca69c8d9-e134-41f9-98fb-52721bed505f-serviceca\") pod \"node-ca-tq8xq\" (UID: \"ca69c8d9-e134-41f9-98fb-52721bed505f\") " pod="openshift-image-registry/node-ca-tq8xq"
Jul 02 12:38:50.750154 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-systemd-units\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.750154 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-system-cni-dir\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.750154 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-sysconfig\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.750154 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.750154 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.748933    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-host-run-k8s-cni-cncf-io\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.750154 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.749009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-node-log\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.750154 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.749046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-cni-netd\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.750154 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.749072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-registration-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.755958 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.755939    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 12:38:50.758801 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.758776    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vp99\" (UniqueName: \"kubernetes.io/projected/cd7d04ce-d45e-4afd-9ee3-59ee3d41450d-kube-api-access-5vp99\") pod \"multus-jl58l\" (UID: \"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d\") " pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.758876 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.758785    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgtql\" (UniqueName: \"kubernetes.io/projected/ca69c8d9-e134-41f9-98fb-52721bed505f-kube-api-access-xgtql\") pod \"node-ca-tq8xq\" (UID: \"ca69c8d9-e134-41f9-98fb-52721bed505f\") " pod="openshift-image-registry/node-ca-tq8xq"
Jul 02 12:38:50.817007 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.816987    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 12:38:50.845773 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.845756    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 12:38:50.849856 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.849843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-run-netns\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.849914 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.849863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cef66cb7-ba61-4dc2-ace0-a2b3558bbb37-iptables-alerter-script\") pod \"iptables-alerter-rwsc6\" (UID: \"cef66cb7-ba61-4dc2-ace0-a2b3558bbb37\") " pod="openshift-network-operator/iptables-alerter-rwsc6"
Jul 02 12:38:50.849914 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.849879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-tuned\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.849914 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.849894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.849914 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.849909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzm5w\" (UniqueName: \"kubernetes.io/projected/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-kube-api-access-dzm5w\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:50.850068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.849923    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-run-systemd\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.850068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.849939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-run-ovn\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.850068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.849956    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-run-netns\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.850068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.849961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-modprobe-d\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.850068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.849997    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.850068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850010    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnxh9\" (UniqueName: \"kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9\") pod \"network-check-target-dhszc\" (UID: \"a40b3102-c663-4d18-b41b-84c6ae90d57c\") " pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:38:50.850068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850013    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-run-ovn\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.850068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850040    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-run-systemd\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.850068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-run\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.850390 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850083    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-run\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.850456 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850428    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-modprobe-d\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.850525 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850504    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-os-release\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.850582 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850093    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-os-release\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.850758 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.850817 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850760    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cef66cb7-ba61-4dc2-ace0-a2b3558bbb37-iptables-alerter-script\") pod \"iptables-alerter-rwsc6\" (UID: \"cef66cb7-ba61-4dc2-ace0-a2b3558bbb37\") " pod="openshift-network-operator/iptables-alerter-rwsc6"
Jul 02 12:38:50.850817 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-tmp\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.850907 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.850959 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w2cn\" (UniqueName: \"kubernetes.io/projected/cef66cb7-ba61-4dc2-ace0-a2b3558bbb37-kube-api-access-5w2cn\") pod \"iptables-alerter-rwsc6\" (UID: \"cef66cb7-ba61-4dc2-ace0-a2b3558bbb37\") " pod="openshift-network-operator/iptables-alerter-rwsc6"
Jul 02 12:38:50.851014 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.850974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-systemd\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.851014 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-cnibin\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.851108 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-host\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.851108 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:50.851202 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-var-lib-openvswitch\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.851202 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-device-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.851202 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-sys-fs\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.851345 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8vwx\" (UniqueName: \"kubernetes.io/projected/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-kube-api-access-q8vwx\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.851345 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-run-ovn-kubernetes\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.851345 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851256    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-var-lib-openvswitch\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.851345 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851256    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-host\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.851345 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2cf6e252-53bd-4150-af7b-0bd18556f36a-ovnkube-config\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.851345 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851306    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-cnibin\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.851345 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851320    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed9ea745-2599-4556-8d74-f24466245547-agent-certs\") pod \"konnectivity-agent-9rklj\" (UID: \"ed9ea745-2599-4556-8d74-f24466245547\") " pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:38:50.851345 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851329    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-systemd\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.851744 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851377    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-device-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.851744 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-kubelet\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.851744 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-systemd-units\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.851744 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851641    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-sys-fs\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.851744 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851729    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-etc-selinux\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.851986 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.851939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-system-cni-dir\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.852050 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852031    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.852210 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852191    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-kubelet\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.852309 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.852295    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 12:38:50.852403 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.852392    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret podName:ba57525a-aa69-48d0-a51b-d631b1fde187 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:51.352356849 +0000 UTC m=+2.084617255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret") pod "global-pull-secret-syncer-sw5dm" (UID: "ba57525a-aa69-48d0-a51b-d631b1fde187") : object "kube-system"/"original-pull-secret" not registered
Jul 02 12:38:50.852666 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-sysconfig\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.852713 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852699    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.852752 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-node-log\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.852785 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-cni-netd\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.852822 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-registration-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.852857 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmrm6\" (UniqueName: \"kubernetes.io/projected/1718a22e-65f2-4062-9425-ec7266e9d552-kube-api-access-rmrm6\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.852893 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-kubernetes\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.852925 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-socket-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.852957 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852926    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:50.852991 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead7f268-0162-428f-9cf4-f72141d2c2f3-tmp-dir\") pod \"node-resolver-drc6k\" (UID: \"ead7f268-0162-428f-9cf4-f72141d2c2f3\") " pod="openshift-dns/node-resolver-drc6k"
Jul 02 12:38:50.852991 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.852981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-slash\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.853047 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-cni-binary-copy\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.853079 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m7bg\" (UniqueName: \"kubernetes.io/projected/ead7f268-0162-428f-9cf4-f72141d2c2f3-kube-api-access-4m7bg\") pod \"node-resolver-drc6k\" (UID: \"ead7f268-0162-428f-9cf4-f72141d2c2f3\") " pod="openshift-dns/node-resolver-drc6k"
Jul 02 12:38:50.853108 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-etc-openvswitch\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.853155 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-run-openvswitch\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.853155 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2cf6e252-53bd-4150-af7b-0bd18556f36a-env-overrides\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.853241 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cef66cb7-ba61-4dc2-ace0-a2b3558bbb37-host-slash\") pod \"iptables-alerter-rwsc6\" (UID: \"cef66cb7-ba61-4dc2-ace0-a2b3558bbb37\") " pod="openshift-network-operator/iptables-alerter-rwsc6"
Jul 02 12:38:50.853241 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2cf6e252-53bd-4150-af7b-0bd18556f36a-ovnkube-script-lib\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.853241 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853236    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.853390 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-sysctl-conf\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.853390 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-sys\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.853390 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-cni-bin\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.853390 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72lmb\" (UniqueName: \"kubernetes.io/projected/2cf6e252-53bd-4150-af7b-0bd18556f36a-kube-api-access-72lmb\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.853390 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853383    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-tuned\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.853648 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-var-lib-kubelet\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.853648 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-log-socket\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.853648 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.853648 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853507    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-slash\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.853648 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llh2d\" (UniqueName: \"kubernetes.io/projected/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-kube-api-access-llh2d\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.853648 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-sysctl-d\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.853648 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853572    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-system-cni-dir\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.853648 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-lib-modules\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.854004 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853772    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-tmp\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.854004 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853834    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-sysctl-conf\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.854004 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.853905    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:38:50.854004 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.853975    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs podName:d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc nodeName:}" failed. No retries permitted until 2026-07-02 12:38:51.353958557 +0000 UTC m=+2.086218963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs") pod "network-metrics-daemon-srq4r" (UID: "d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:38:50.854187 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854038    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-kubernetes\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.854187 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854067    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-cni-binary-copy\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.854187 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854104    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-etc-openvswitch\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.854187 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854170    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-socket-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.854187 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854175    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-run-ovn-kubernetes\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.854406 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854227    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-run-openvswitch\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.854406 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854337    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854514    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-var-lib-kubelet\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.853623    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2cf6e252-53bd-4150-af7b-0bd18556f36a-ovn-node-metrics-cert\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854580    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-log-socket\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba57525a-aa69-48d0-a51b-d631b1fde187-kubelet-config\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba57525a-aa69-48d0-a51b-d631b1fde187-dbus\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854640    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-node-log\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed9ea745-2599-4556-8d74-f24466245547-konnectivity-ca\") pod \"konnectivity-agent-9rklj\" (UID: \"ed9ea745-2599-4556-8d74-f24466245547\") " pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ead7f268-0162-428f-9cf4-f72141d2c2f3-hosts-file\") pod \"node-resolver-drc6k\" (UID: \"ead7f268-0162-428f-9cf4-f72141d2c2f3\") " pod="openshift-dns/node-resolver-drc6k"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854775    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ead7f268-0162-428f-9cf4-f72141d2c2f3-hosts-file\") pod \"node-resolver-drc6k\" (UID: \"ead7f268-0162-428f-9cf4-f72141d2c2f3\") " pod="openshift-dns/node-resolver-drc6k"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854782    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2cf6e252-53bd-4150-af7b-0bd18556f36a-ovnkube-config\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854869    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cef66cb7-ba61-4dc2-ace0-a2b3558bbb37-host-slash\") pod \"iptables-alerter-rwsc6\" (UID: \"cef66cb7-ba61-4dc2-ace0-a2b3558bbb37\") " pod="openshift-network-operator/iptables-alerter-rwsc6"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855071    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-cni-netd\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855080    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead7f268-0162-428f-9cf4-f72141d2c2f3-tmp-dir\") pod \"node-resolver-drc6k\" (UID: \"ead7f268-0162-428f-9cf4-f72141d2c2f3\") " pod="openshift-dns/node-resolver-drc6k"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855127    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed9ea745-2599-4556-8d74-f24466245547-agent-certs\") pod \"konnectivity-agent-9rklj\" (UID: \"ed9ea745-2599-4556-8d74-f24466245547\") " pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855153    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-registration-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855176    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed9ea745-2599-4556-8d74-f24466245547-konnectivity-ca\") pod \"konnectivity-agent-9rklj\" (UID: \"ed9ea745-2599-4556-8d74-f24466245547\") " pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855201    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-lib-modules\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.855296 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855219    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1718a22e-65f2-4062-9425-ec7266e9d552-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.856066 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855201    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-systemd-units\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.856066 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855324    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-sysctl-d\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.856066 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855295    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-sys\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.856066 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855376    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba57525a-aa69-48d0-a51b-d631b1fde187-kubelet-config\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:50.856066 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855504    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2cf6e252-53bd-4150-af7b-0bd18556f36a-ovnkube-script-lib\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.856066 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855507    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba57525a-aa69-48d0-a51b-d631b1fde187-dbus\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:50.856066 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.854171    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cf6e252-53bd-4150-af7b-0bd18556f36a-host-cni-bin\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.856066 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855651    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2cf6e252-53bd-4150-af7b-0bd18556f36a-env-overrides\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.856066 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855648    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.856066 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.855764    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-etc-sysconfig\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.857048 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.857033    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 12:38:50.857048 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.857050    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 12:38:50.857146 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.857059    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nnxh9 for pod openshift-network-diagnostics/network-check-target-dhszc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:38:50.857146 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:50.857108    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9 podName:a40b3102-c663-4d18-b41b-84c6ae90d57c nodeName:}" failed. No retries permitted until 2026-07-02 12:38:51.357096534 +0000 UTC m=+2.089356921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nnxh9" (UniqueName: "kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9") pod "network-check-target-dhszc" (UID: "a40b3102-c663-4d18-b41b-84c6ae90d57c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:38:50.857339 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.857323    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2cf6e252-53bd-4150-af7b-0bd18556f36a-ovn-node-metrics-cert\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.858991 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.858967    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzm5w\" (UniqueName: \"kubernetes.io/projected/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-kube-api-access-dzm5w\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:50.860104 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.860088    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8vwx\" (UniqueName: \"kubernetes.io/projected/e5bb6aab-d910-4279-9ead-0dbd2ac37d3a-kube-api-access-q8vwx\") pod \"tuned-qbqgv\" (UID: \"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a\") " pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:50.862612 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.862585    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m7bg\" (UniqueName: \"kubernetes.io/projected/ead7f268-0162-428f-9cf4-f72141d2c2f3-kube-api-access-4m7bg\") pod \"node-resolver-drc6k\" (UID: \"ead7f268-0162-428f-9cf4-f72141d2c2f3\") " pod="openshift-dns/node-resolver-drc6k"
Jul 02 12:38:50.862756 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.862741    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72lmb\" (UniqueName: \"kubernetes.io/projected/2cf6e252-53bd-4150-af7b-0bd18556f36a-kube-api-access-72lmb\") pod \"ovnkube-node-sv8zr\" (UID: \"2cf6e252-53bd-4150-af7b-0bd18556f36a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.862908 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.862884    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmrm6\" (UniqueName: \"kubernetes.io/projected/1718a22e-65f2-4062-9425-ec7266e9d552-kube-api-access-rmrm6\") pod \"aws-ebs-csi-driver-node-fcw6j\" (UID: \"1718a22e-65f2-4062-9425-ec7266e9d552\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.863215 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.863193    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llh2d\" (UniqueName: \"kubernetes.io/projected/734fdd4c-fc93-4f2e-bdea-b7d72b2d646e-kube-api-access-llh2d\") pod \"multus-additional-cni-plugins-s228p\" (UID: \"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e\") " pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.863337 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.863321    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w2cn\" (UniqueName: \"kubernetes.io/projected/cef66cb7-ba61-4dc2-ace0-a2b3558bbb37-kube-api-access-5w2cn\") pod \"iptables-alerter-rwsc6\" (UID: \"cef66cb7-ba61-4dc2-ace0-a2b3558bbb37\") " pod="openshift-network-operator/iptables-alerter-rwsc6"
Jul 02 12:38:50.953052 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.953000    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tq8xq"
Jul 02 12:38:50.959698 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.959683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jl58l"
Jul 02 12:38:50.960699 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:50.960678    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca69c8d9_e134_41f9_98fb_52721bed505f.slice/crio-35f57b91208614d41a40ca0d7eb8069831b95e2de7509c1fcf8c0093e86f386d WatchSource:0}: Error finding container 35f57b91208614d41a40ca0d7eb8069831b95e2de7509c1fcf8c0093e86f386d: Status 404 returned error can't find the container with id 35f57b91208614d41a40ca0d7eb8069831b95e2de7509c1fcf8c0093e86f386d
Jul 02 12:38:50.966141 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.966121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:38:50.966283 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:50.966264    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7d04ce_d45e_4afd_9ee3_59ee3d41450d.slice/crio-4c2be4ef91efa554a4675cb4d84ada1543ab60953943aca12969ef4b30e6ccc7 WatchSource:0}: Error finding container 4c2be4ef91efa554a4675cb4d84ada1543ab60953943aca12969ef4b30e6ccc7: Status 404 returned error can't find the container with id 4c2be4ef91efa554a4675cb4d84ada1543ab60953943aca12969ef4b30e6ccc7
Jul 02 12:38:50.970094 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.970079    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:38:50.974248 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:50.974149    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf6e252_53bd_4150_af7b_0bd18556f36a.slice/crio-a0b403a2aca19683794fc219ebbf9e052a3d114083f13090876918a102f74b1f WatchSource:0}: Error finding container a0b403a2aca19683794fc219ebbf9e052a3d114083f13090876918a102f74b1f: Status 404 returned error can't find the container with id a0b403a2aca19683794fc219ebbf9e052a3d114083f13090876918a102f74b1f
Jul 02 12:38:50.975747 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.975727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j"
Jul 02 12:38:50.979380 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:50.979361    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded9ea745_2599_4556_8d74_f24466245547.slice/crio-7ba57de355a8270099b410fe509bc4ca0dd7fbb36cd7c8635b49db532c536461 WatchSource:0}: Error finding container 7ba57de355a8270099b410fe509bc4ca0dd7fbb36cd7c8635b49db532c536461: Status 404 returned error can't find the container with id 7ba57de355a8270099b410fe509bc4ca0dd7fbb36cd7c8635b49db532c536461
Jul 02 12:38:50.982642 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.982619    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-drc6k"
Jul 02 12:38:50.982859 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:50.982843    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1718a22e_65f2_4062_9425_ec7266e9d552.slice/crio-866176fbe1882ede54ff5f8d92dcc7ae13a027a0235cc74ad5a975fc5fb001eb WatchSource:0}: Error finding container 866176fbe1882ede54ff5f8d92dcc7ae13a027a0235cc74ad5a975fc5fb001eb: Status 404 returned error can't find the container with id 866176fbe1882ede54ff5f8d92dcc7ae13a027a0235cc74ad5a975fc5fb001eb
Jul 02 12:38:50.987529 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.987511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s228p"
Jul 02 12:38:50.989763 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:50.989732    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead7f268_0162_428f_9cf4_f72141d2c2f3.slice/crio-7eb09a10fc3787319fb247fc26898255f7736a99b1f6e99cadef22f2a005ffd5 WatchSource:0}: Error finding container 7eb09a10fc3787319fb247fc26898255f7736a99b1f6e99cadef22f2a005ffd5: Status 404 returned error can't find the container with id 7eb09a10fc3787319fb247fc26898255f7736a99b1f6e99cadef22f2a005ffd5
Jul 02 12:38:50.994108 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.994081    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rwsc6"
Jul 02 12:38:50.994315 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:50.994299    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734fdd4c_fc93_4f2e_bdea_b7d72b2d646e.slice/crio-99e47a43ff16c13954fc0945c67d541a64d90765823e8f543b3fdc8f5660fe76 WatchSource:0}: Error finding container 99e47a43ff16c13954fc0945c67d541a64d90765823e8f543b3fdc8f5660fe76: Status 404 returned error can't find the container with id 99e47a43ff16c13954fc0945c67d541a64d90765823e8f543b3fdc8f5660fe76
Jul 02 12:38:50.998321 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:50.998302    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qbqgv"
Jul 02 12:38:51.000937 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:51.000920    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef66cb7_ba61_4dc2_ace0_a2b3558bbb37.slice/crio-3eabef18e37aaa3a193297856d48855fc3aec9f5720cad84cce765ac6e1d49b9 WatchSource:0}: Error finding container 3eabef18e37aaa3a193297856d48855fc3aec9f5720cad84cce765ac6e1d49b9: Status 404 returned error can't find the container with id 3eabef18e37aaa3a193297856d48855fc3aec9f5720cad84cce765ac6e1d49b9
Jul 02 12:38:51.005216 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:38:51.005196    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5bb6aab_d910_4279_9ead_0dbd2ac37d3a.slice/crio-b9ce81ab1cc2c27f703c011478eb3e203e19f6bc49635daf1e09b9558e10a8d5 WatchSource:0}: Error finding container b9ce81ab1cc2c27f703c011478eb3e203e19f6bc49635daf1e09b9558e10a8d5: Status 404 returned error can't find the container with id b9ce81ab1cc2c27f703c011478eb3e203e19f6bc49635daf1e09b9558e10a8d5
Jul 02 12:38:51.358851 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.358817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:51.359014 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.358903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnxh9\" (UniqueName: \"kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9\") pod \"network-check-target-dhszc\" (UID: \"a40b3102-c663-4d18-b41b-84c6ae90d57c\") " pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:38:51.359014 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.358944    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:51.359142 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:51.359078    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 12:38:51.359142 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:51.359140    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret podName:ba57525a-aa69-48d0-a51b-d631b1fde187 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:52.359119462 +0000 UTC m=+3.091379855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret") pod "global-pull-secret-syncer-sw5dm" (UID: "ba57525a-aa69-48d0-a51b-d631b1fde187") : object "kube-system"/"original-pull-secret" not registered
Jul 02 12:38:51.359478 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:51.359462    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 12:38:51.359563 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:51.359486    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 12:38:51.359563 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:51.359499    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nnxh9 for pod openshift-network-diagnostics/network-check-target-dhszc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:38:51.359563 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:51.359506    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:38:51.359738 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:51.359567    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9 podName:a40b3102-c663-4d18-b41b-84c6ae90d57c nodeName:}" failed. No retries permitted until 2026-07-02 12:38:52.359553281 +0000 UTC m=+3.091813690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnxh9" (UniqueName: "kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9") pod "network-check-target-dhszc" (UID: "a40b3102-c663-4d18-b41b-84c6ae90d57c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:38:51.359738 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:51.359588    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs podName:d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc nodeName:}" failed. No retries permitted until 2026-07-02 12:38:52.359579154 +0000 UTC m=+3.091839557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs") pod "network-metrics-daemon-srq4r" (UID: "d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:38:51.685832 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.685732    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 12:33:51 +0000 UTC" deadline="2028-03-09 11:33:14.805116542 +0000 UTC"
Jul 02 12:38:51.685832 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.685775    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14782h54m23.119346309s"
Jul 02 12:38:51.739203 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.739118    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j" event={"ID":"1718a22e-65f2-4062-9425-ec7266e9d552","Type":"ContainerStarted","Data":"866176fbe1882ede54ff5f8d92dcc7ae13a027a0235cc74ad5a975fc5fb001eb"}
Jul 02 12:38:51.754732 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.754706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr" event={"ID":"2cf6e252-53bd-4150-af7b-0bd18556f36a","Type":"ContainerStarted","Data":"a0b403a2aca19683794fc219ebbf9e052a3d114083f13090876918a102f74b1f"}
Jul 02 12:38:51.759295 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.759263    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jl58l" event={"ID":"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d","Type":"ContainerStarted","Data":"4c2be4ef91efa554a4675cb4d84ada1543ab60953943aca12969ef4b30e6ccc7"}
Jul 02 12:38:51.761610 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.761585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tq8xq" event={"ID":"ca69c8d9-e134-41f9-98fb-52721bed505f","Type":"ContainerStarted","Data":"35f57b91208614d41a40ca0d7eb8069831b95e2de7509c1fcf8c0093e86f386d"}
Jul 02 12:38:51.786456 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.786402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qbqgv" event={"ID":"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a","Type":"ContainerStarted","Data":"b9ce81ab1cc2c27f703c011478eb3e203e19f6bc49635daf1e09b9558e10a8d5"}
Jul 02 12:38:51.794682 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.794657    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rwsc6" event={"ID":"cef66cb7-ba61-4dc2-ace0-a2b3558bbb37","Type":"ContainerStarted","Data":"3eabef18e37aaa3a193297856d48855fc3aec9f5720cad84cce765ac6e1d49b9"}
Jul 02 12:38:51.803708 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.803681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s228p" event={"ID":"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e","Type":"ContainerStarted","Data":"99e47a43ff16c13954fc0945c67d541a64d90765823e8f543b3fdc8f5660fe76"}
Jul 02 12:38:51.818521 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.818478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9rklj" event={"ID":"ed9ea745-2599-4556-8d74-f24466245547","Type":"ContainerStarted","Data":"7ba57de355a8270099b410fe509bc4ca0dd7fbb36cd7c8635b49db532c536461"}
Jul 02 12:38:51.827843 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:51.827818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-drc6k" event={"ID":"ead7f268-0162-428f-9cf4-f72141d2c2f3","Type":"ContainerStarted","Data":"7eb09a10fc3787319fb247fc26898255f7736a99b1f6e99cadef22f2a005ffd5"}
Jul 02 12:38:52.108761 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:52.108728    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 12:38:52.364761 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:52.364683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:52.364761 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:52.364740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:52.364982 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:52.364801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnxh9\" (UniqueName: \"kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9\") pod \"network-check-target-dhszc\" (UID: \"a40b3102-c663-4d18-b41b-84c6ae90d57c\") " pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:38:52.364982 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:52.364962    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 12:38:52.365101 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:52.365023    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret podName:ba57525a-aa69-48d0-a51b-d631b1fde187 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:54.365003742 +0000 UTC m=+5.097264137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret") pod "global-pull-secret-syncer-sw5dm" (UID: "ba57525a-aa69-48d0-a51b-d631b1fde187") : object "kube-system"/"original-pull-secret" not registered
Jul 02 12:38:52.365435 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:52.365415    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:38:52.365533 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:52.365478    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs podName:d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc nodeName:}" failed. No retries permitted until 2026-07-02 12:38:54.365462681 +0000 UTC m=+5.097723071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs") pod "network-metrics-daemon-srq4r" (UID: "d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:38:52.365825 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:52.365645    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 12:38:52.365825 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:52.365678    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 12:38:52.365825 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:52.365691    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nnxh9 for pod openshift-network-diagnostics/network-check-target-dhszc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:38:52.365825 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:52.365739    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9 podName:a40b3102-c663-4d18-b41b-84c6ae90d57c nodeName:}" failed. No retries permitted until 2026-07-02 12:38:54.365724388 +0000 UTC m=+5.097984777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnxh9" (UniqueName: "kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9") pod "network-check-target-dhszc" (UID: "a40b3102-c663-4d18-b41b-84c6ae90d57c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:38:52.686076 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:52.685957    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 12:33:51 +0000 UTC" deadline="2028-02-22 04:43:25.500989571 +0000 UTC"
Jul 02 12:38:52.686076 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:52.685996    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14392h4m32.814998368s"
Jul 02 12:38:52.701808 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:52.700987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:52.701808 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:52.701114    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:38:52.701808 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:52.701527    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:38:52.701808 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:52.701615    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:38:52.701808 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:52.701680    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:52.701808 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:52.701768    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:38:53.203472 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:53.203244    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 12:38:54.382583 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:54.382543    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnxh9\" (UniqueName: \"kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9\") pod \"network-check-target-dhszc\" (UID: \"a40b3102-c663-4d18-b41b-84c6ae90d57c\") " pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:38:54.383234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:54.382606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:54.383234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:54.382651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:54.383234 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:54.382772    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:38:54.383234 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:54.382833    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs podName:d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc nodeName:}" failed. No retries permitted until 2026-07-02 12:38:58.382813194 +0000 UTC m=+9.115073592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs") pod "network-metrics-daemon-srq4r" (UID: "d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:38:54.383527 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:54.383313    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 12:38:54.383527 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:54.383338    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 12:38:54.383527 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:54.383353    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nnxh9 for pod openshift-network-diagnostics/network-check-target-dhszc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:38:54.383527 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:54.383402    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9 podName:a40b3102-c663-4d18-b41b-84c6ae90d57c nodeName:}" failed. No retries permitted until 2026-07-02 12:38:58.383386325 +0000 UTC m=+9.115646718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnxh9" (UniqueName: "kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9") pod "network-check-target-dhszc" (UID: "a40b3102-c663-4d18-b41b-84c6ae90d57c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:38:54.383527 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:54.383461    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 12:38:54.383527 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:54.383492    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret podName:ba57525a-aa69-48d0-a51b-d631b1fde187 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:58.383481209 +0000 UTC m=+9.115741600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret") pod "global-pull-secret-syncer-sw5dm" (UID: "ba57525a-aa69-48d0-a51b-d631b1fde187") : object "kube-system"/"original-pull-secret" not registered
Jul 02 12:38:54.700774 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:54.700695    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:54.700931 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:54.700806    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:38:54.701217 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:54.701196    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:38:54.701522 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:54.701305    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:38:54.701522 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:54.701357    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:54.701522 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:54.701415    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:38:56.700702 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:56.700667    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:56.701137 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:56.700804    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:38:56.701137 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:56.700668    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:38:56.701137 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:56.700892    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:38:56.701137 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:56.700667    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:56.701137 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:56.700968    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:38:58.414525 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:58.414489    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:58.414902 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:58.414550    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnxh9\" (UniqueName: \"kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9\") pod \"network-check-target-dhszc\" (UID: \"a40b3102-c663-4d18-b41b-84c6ae90d57c\") " pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:38:58.414902 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:58.414578    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:58.414902 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:58.414705    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 12:38:58.414902 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:58.414759    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret podName:ba57525a-aa69-48d0-a51b-d631b1fde187 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:06.414741282 +0000 UTC m=+17.147001668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret") pod "global-pull-secret-syncer-sw5dm" (UID: "ba57525a-aa69-48d0-a51b-d631b1fde187") : object "kube-system"/"original-pull-secret" not registered
Jul 02 12:38:58.414902 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:58.414767    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:38:58.414902 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:58.414795    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 12:38:58.414902 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:58.414815    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 12:38:58.414902 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:58.414825    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nnxh9 for pod openshift-network-diagnostics/network-check-target-dhszc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:38:58.414902 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:58.414828    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs podName:d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc nodeName:}" failed. No retries permitted until 2026-07-02 12:39:06.414810226 +0000 UTC m=+17.147070613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs") pod "network-metrics-daemon-srq4r" (UID: "d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:38:58.414902 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:58.414857    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9 podName:a40b3102-c663-4d18-b41b-84c6ae90d57c nodeName:}" failed. No retries permitted until 2026-07-02 12:39:06.414847079 +0000 UTC m=+17.147107469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnxh9" (UniqueName: "kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9") pod "network-check-target-dhszc" (UID: "a40b3102-c663-4d18-b41b-84c6ae90d57c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:38:58.701155 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:58.701073    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:38:58.701310 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:58.701073    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:38:58.701310 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:58.701198    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:38:58.701310 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:38:58.701222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:38:58.701498 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:58.701357    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:38:58.701498 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:38:58.701460    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:00.700548 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:00.700473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:00.700975 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:00.700574    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:00.700975 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:00.700589    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:00.700975 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:00.700617    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:00.700975 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:00.700713    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:00.700975 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:00.700807    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:02.700333 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:02.700305    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:02.700671 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:02.700330    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:02.700671 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:02.700305    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:02.700671 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:02.700418    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:02.700671 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:02.700514    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:02.700671 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:02.700573    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:04.701272 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:04.701238    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:04.701272 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:04.701259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:04.701808 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:04.701352    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:04.701808 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:04.701403    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:04.701808 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:04.701456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:04.701808 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:04.701533    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:06.482279 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:06.482248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:06.482754 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:06.482312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnxh9\" (UniqueName: \"kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9\") pod \"network-check-target-dhszc\" (UID: \"a40b3102-c663-4d18-b41b-84c6ae90d57c\") " pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:06.482754 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:06.482356    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:06.482754 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:06.482423    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:39:06.482754 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:06.482455    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 12:39:06.482754 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:06.482466    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 12:39:06.482754 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:06.482479    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 12:39:06.482754 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:06.482491    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nnxh9 for pod openshift-network-diagnostics/network-check-target-dhszc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:39:06.482754 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:06.482508    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs podName:d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc nodeName:}" failed. No retries permitted until 2026-07-02 12:39:22.482487115 +0000 UTC m=+33.214747520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs") pod "network-metrics-daemon-srq4r" (UID: "d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:39:06.482754 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:06.482531    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret podName:ba57525a-aa69-48d0-a51b-d631b1fde187 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:22.482514993 +0000 UTC m=+33.214775389 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret") pod "global-pull-secret-syncer-sw5dm" (UID: "ba57525a-aa69-48d0-a51b-d631b1fde187") : object "kube-system"/"original-pull-secret" not registered
Jul 02 12:39:06.482754 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:06.482551    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9 podName:a40b3102-c663-4d18-b41b-84c6ae90d57c nodeName:}" failed. No retries permitted until 2026-07-02 12:39:22.482544822 +0000 UTC m=+33.214805209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnxh9" (UniqueName: "kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9") pod "network-check-target-dhszc" (UID: "a40b3102-c663-4d18-b41b-84c6ae90d57c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:39:06.701005 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:06.700974    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:06.701187 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:06.701017    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:06.701187 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:06.701017    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:06.701187 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:06.701083    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:06.701364 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:06.701187    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:06.701364 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:06.701284    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:08.700813 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:08.700782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:08.701213 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:08.700787    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:08.701213 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:08.700882    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:08.701213 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:08.700788    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:08.701213 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:08.700981    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:08.701213 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:08.701084    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:10.701092 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:10.701061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:10.701461 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:10.701062    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:10.701461 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:10.701153    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:10.701461 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:10.701062    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:10.701461 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:10.701244    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:10.701461 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:10.701299    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:11.890787 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.890403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" event={"ID":"5fb27810fb6dc0f9781a737032e64eed","Type":"ContainerStarted","Data":"3f6b21a62fe201584fc0dc94f1048e7a4adefe792061ba7da23fd3eb99954b78"}
Jul 02 12:39:11.893497 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.893477    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 12:39:11.893831 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.893812    2560 generic.go:356] "Generic (PLEG): container finished" podID="2cf6e252-53bd-4150-af7b-0bd18556f36a" containerID="196806ef6af5015abf7e6a072b88a189c7c68fec6c1168877e5607174209280f" exitCode=1
Jul 02 12:39:11.893898 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.893876    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr" event={"ID":"2cf6e252-53bd-4150-af7b-0bd18556f36a","Type":"ContainerStarted","Data":"5053ccb21248108532a706ccdc9f3061de3da49d9369ee56423bd7a216728c82"}
Jul 02 12:39:11.893943 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.893933    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr" event={"ID":"2cf6e252-53bd-4150-af7b-0bd18556f36a","Type":"ContainerStarted","Data":"bac8579daeea04dbea93a6d76de6fbb0fde23708d30a5ea113da191e8237c79e"}
Jul 02 12:39:11.893990 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.893966    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr" event={"ID":"2cf6e252-53bd-4150-af7b-0bd18556f36a","Type":"ContainerStarted","Data":"c4726edb915f82477393999a3cb1094059f270a9aff8bfdd5c2c58307833be88"}
Jul 02 12:39:11.894053 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.894014    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr" event={"ID":"2cf6e252-53bd-4150-af7b-0bd18556f36a","Type":"ContainerStarted","Data":"e3a192ff25be5e27b1d71275736c05afc0fb552854d9dd38db4ab04c2645d18d"}
Jul 02 12:39:11.894053 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.894050    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr" event={"ID":"2cf6e252-53bd-4150-af7b-0bd18556f36a","Type":"ContainerDied","Data":"196806ef6af5015abf7e6a072b88a189c7c68fec6c1168877e5607174209280f"}
Jul 02 12:39:11.894173 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.894091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr" event={"ID":"2cf6e252-53bd-4150-af7b-0bd18556f36a","Type":"ContainerStarted","Data":"365161b8a91deb2175814fc410e91ffd3327d0a8044e23f8181b258aba2b7200"}
Jul 02 12:39:11.895278 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.895259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jl58l" event={"ID":"cd7d04ce-d45e-4afd-9ee3-59ee3d41450d","Type":"ContainerStarted","Data":"8adf6cf2f2db9e69aef01398deb792e26af4d2731480985b1787a7d47c03e65f"}
Jul 02 12:39:11.896600 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.896578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qbqgv" event={"ID":"e5bb6aab-d910-4279-9ead-0dbd2ac37d3a","Type":"ContainerStarted","Data":"31280f8a9363d6bfa07e41a62bb10af5b012040f66ff1b7c5112368acb3cbe91"}
Jul 02 12:39:11.927606 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.927570    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-177.ec2.internal" podStartSLOduration=21.927557632 podStartE2EDuration="21.927557632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:11.906939912 +0000 UTC m=+22.639200321" watchObservedRunningTime="2026-07-02 12:39:11.927557632 +0000 UTC m=+22.659818041"
Jul 02 12:39:11.927707 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.927628    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qbqgv" podStartSLOduration=1.863233267 podStartE2EDuration="21.927623635s" totalImagesPullingTime="20.064390368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:11.927062779 +0000 UTC m=+22.659323187" watchObservedRunningTime="2026-07-02 12:39:11.927623635 +0000 UTC m=+22.659884044"
Jul 02 12:39:11.946307 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:11.946273    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jl58l" podStartSLOduration=1.7108555189999999 podStartE2EDuration="21.946261308s" totalImagesPullingTime="20.235405789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:11.945614883 +0000 UTC m=+22.677875295" watchObservedRunningTime="2026-07-02 12:39:11.946261308 +0000 UTC m=+22.678521714"
Jul 02 12:39:12.700951 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.700886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:12.700951 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.700904    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:12.701148 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.700886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:12.701148 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:12.700993    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:12.701148 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:12.701081    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:12.701272 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:12.701165    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:12.900938 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.900903    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tq8xq" event={"ID":"ca69c8d9-e134-41f9-98fb-52721bed505f","Type":"ContainerStarted","Data":"83534b1c60eae57e02d9fc3b547fce3ce54c2141288b784c8d44ae83a1865fd0"}
Jul 02 12:39:12.902677 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.902628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rwsc6" event={"ID":"cef66cb7-ba61-4dc2-ace0-a2b3558bbb37","Type":"ContainerStarted","Data":"e79d8c9c260966876fc17e62f0729cb6eca3233e53f6a2b2ec058edcd437f49b"}
Jul 02 12:39:12.904242 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.904220    2560 generic.go:356] "Generic (PLEG): container finished" podID="734fdd4c-fc93-4f2e-bdea-b7d72b2d646e" containerID="8b42b9625e5739d5e4b3152a3afac9baddcc06309b69a047ba90a5d48d56ea6b" exitCode=0
Jul 02 12:39:12.904368 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.904302    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s228p" event={"ID":"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e","Type":"ContainerDied","Data":"8b42b9625e5739d5e4b3152a3afac9baddcc06309b69a047ba90a5d48d56ea6b"}
Jul 02 12:39:12.907596 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.907571    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9rklj" event={"ID":"ed9ea745-2599-4556-8d74-f24466245547","Type":"ContainerStarted","Data":"8e4746207a2f548fa8654bfefc5d1af701dff1da7d79168612fb895c8cc93d9c"}
Jul 02 12:39:12.909450 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.909414    2560 generic.go:356] "Generic (PLEG): container finished" podID="b8fda05825405a6c05553e16605a4784" containerID="581d825fe3dec978b910eba236c99c1cb46e560944f8ea005dffa48e827c44d4" exitCode=0
Jul 02 12:39:12.909543 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.909462    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" event={"ID":"b8fda05825405a6c05553e16605a4784","Type":"ContainerDied","Data":"581d825fe3dec978b910eba236c99c1cb46e560944f8ea005dffa48e827c44d4"}
Jul 02 12:39:12.910994 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.910971    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-drc6k" event={"ID":"ead7f268-0162-428f-9cf4-f72141d2c2f3","Type":"ContainerStarted","Data":"3c0d7433e8bf774c161006af87611067e0b5336c1f6c12cfe97c3a9321a46e8f"}
Jul 02 12:39:12.912617 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.912596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j" event={"ID":"1718a22e-65f2-4062-9425-ec7266e9d552","Type":"ContainerStarted","Data":"60122bd815f0d5a2a8482a9f61360d8bdb8b298ab68dedce393d6200d40a1de3"}
Jul 02 12:39:12.921883 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.921840    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tq8xq" podStartSLOduration=2.814358509 podStartE2EDuration="22.921826246s" totalImagesPullingTime="20.107467737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:12.921344831 +0000 UTC m=+23.653605239" watchObservedRunningTime="2026-07-02 12:39:12.921826246 +0000 UTC m=+23.654086637"
Jul 02 12:39:12.969402 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:12.969330    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rwsc6" podStartSLOduration=2.901066553 podStartE2EDuration="22.969313138s" totalImagesPullingTime="20.068246585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:12.969236035 +0000 UTC m=+23.701496445" watchObservedRunningTime="2026-07-02 12:39:12.969313138 +0000 UTC m=+23.701573548"
Jul 02 12:39:13.021812 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:13.021772    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9rklj" podStartSLOduration=2.960085725 podStartE2EDuration="23.021756717s" totalImagesPullingTime="20.061670992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:12.99691343 +0000 UTC m=+23.729173858" watchObservedRunningTime="2026-07-02 12:39:13.021756717 +0000 UTC m=+23.754017126"
Jul 02 12:39:13.021941 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:13.021913    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-drc6k" podStartSLOduration=2.943982776 podStartE2EDuration="23.021907701s" totalImagesPullingTime="20.077924925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:13.02112974 +0000 UTC m=+23.753390151" watchObservedRunningTime="2026-07-02 12:39:13.021907701 +0000 UTC m=+23.754168110"
Jul 02 12:39:13.425879 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:13.425739    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 12:39:13.720763 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:13.720677    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T12:39:13.425875735Z","UUID":"586a4c14-a65f-4dc9-a363-467c163b7979","Handler":null,"Name":"","Endpoint":""}
Jul 02 12:39:13.722248 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:13.722221    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 12:39:13.722377 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:13.722260    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 12:39:13.748418 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:13.748377    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rklj_ed9ea745-2599-4556-8d74-f24466245547/konnectivity-agent/0.log" limit=1024
Jul 02 12:39:13.847159 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:13.847107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9rklj_ed9ea745-2599-4556-8d74-f24466245547/konnectivity-agent/0.log" limit=1024
Jul 02 12:39:13.916689 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:13.916662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j" event={"ID":"1718a22e-65f2-4062-9425-ec7266e9d552","Type":"ContainerStarted","Data":"ca36664b028587b1dab30a7d85f3a4404861bbf01ac24f58dcfc52a86c5d59fe"}
Jul 02 12:39:13.918552 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:13.918527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" event={"ID":"b8fda05825405a6c05553e16605a4784","Type":"ContainerStarted","Data":"33d337a1a6fe96917b3711a1616af0f75a5aecd4468b43eaf0a75b694ad520f6"}
Jul 02 12:39:13.936608 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:13.936566    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-177.ec2.internal" podStartSLOduration=23.936548142 podStartE2EDuration="23.936548142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:13.936498312 +0000 UTC m=+24.668758745" watchObservedRunningTime="2026-07-02 12:39:13.936548142 +0000 UTC m=+24.668808552"
Jul 02 12:39:14.700914 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:14.700891    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:14.701067 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:14.701002    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:14.701067 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:14.701005    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:14.701179 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:14.700996    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:14.701179 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:14.701095    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:14.701279 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:14.701204    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:14.923444 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:14.923402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j" event={"ID":"1718a22e-65f2-4062-9425-ec7266e9d552","Type":"ContainerStarted","Data":"3a70f57e9aadfb43b8c40903386abba4259057befe6af38f111b78f45d1b20b9"}
Jul 02 12:39:14.927460 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:14.927421    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 12:39:14.927857 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:14.927828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr" event={"ID":"2cf6e252-53bd-4150-af7b-0bd18556f36a","Type":"ContainerStarted","Data":"3927d768068b722733473ca14bfa2cad472a8e9972d2512e47d866a1981a6c62"}
Jul 02 12:39:16.503424 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:16.503393    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:39:16.503943 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:16.503928    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:39:16.520941 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:16.520891    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fcw6j" podStartSLOduration=4.203032211 podStartE2EDuration="26.5208783s" totalImagesPullingTime="22.317846089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:14.946557083 +0000 UTC m=+25.678817493" watchObservedRunningTime="2026-07-02 12:39:16.5208783 +0000 UTC m=+27.253138708"
Jul 02 12:39:16.701052 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:16.701026    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:16.701212 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:16.701034    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:16.701212 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:16.701122    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:16.701212 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:16.701034    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:16.701369 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:16.701219    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:16.701369 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:16.701293    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:16.932461 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:16.932414    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:39:16.932953 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:16.932932    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9rklj"
Jul 02 12:39:17.935529 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:17.935354    2560 generic.go:356] "Generic (PLEG): container finished" podID="734fdd4c-fc93-4f2e-bdea-b7d72b2d646e" containerID="e83f0dc4ab4014b056b018fafbeeb279a6c85a8c47651079f4404853e4552eb7" exitCode=0
Jul 02 12:39:17.936177 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:17.935455    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s228p" event={"ID":"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e","Type":"ContainerDied","Data":"e83f0dc4ab4014b056b018fafbeeb279a6c85a8c47651079f4404853e4552eb7"}
Jul 02 12:39:17.939006 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:17.938990    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 12:39:17.939336 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:17.939316    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr" event={"ID":"2cf6e252-53bd-4150-af7b-0bd18556f36a","Type":"ContainerStarted","Data":"4a63f01192ba4ae74990551fe057c5b1718a8782a72ee3943b34009e44b88e77"}
Jul 02 12:39:17.939559 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:17.939542    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:39:17.939670 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:17.939658    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:39:17.939751 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:17.939698    2560 scope.go:117] "RemoveContainer" containerID="196806ef6af5015abf7e6a072b88a189c7c68fec6c1168877e5607174209280f"
Jul 02 12:39:17.954891 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:17.954875    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:39:18.701260 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:18.701232    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:18.701441 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:18.701322    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:18.701441 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:18.701329    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:18.701441 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:18.701347    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:18.701601 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:18.701424    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:18.701601 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:18.701549    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:18.945687 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:18.945659    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 12:39:18.946186 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:18.946095    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr" event={"ID":"2cf6e252-53bd-4150-af7b-0bd18556f36a","Type":"ContainerStarted","Data":"203f90dd568c8a2c71a348b4d7f2599784b84c3901cf96322c6e48d16b68b5f1"}
Jul 02 12:39:18.946257 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:18.946241    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:39:18.960207 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:18.960159    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:39:18.980141 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:18.980104    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr" podStartSLOduration=8.871628469000001 podStartE2EDuration="28.980091267s" totalImagesPullingTime="20.108462798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:18.978286586 +0000 UTC m=+29.710546994" watchObservedRunningTime="2026-07-02 12:39:18.980091267 +0000 UTC m=+29.712351676"
Jul 02 12:39:19.309759 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:19.309540    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sw5dm"]
Jul 02 12:39:19.309869 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:19.309792    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:19.309907 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:19.309871    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:19.312343 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:19.312321    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-srq4r"]
Jul 02 12:39:19.312465 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:19.312418    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:19.312524 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:19.312507    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:19.321578 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:19.321557    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dhszc"]
Jul 02 12:39:19.321679 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:19.321634    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:19.321746 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:19.321701    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:19.949699 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:19.949672    2560 generic.go:356] "Generic (PLEG): container finished" podID="734fdd4c-fc93-4f2e-bdea-b7d72b2d646e" containerID="3726c047484cd10f47486d7f6e90d842ea87d7c1ab13b0b498c1735f30944622" exitCode=0
Jul 02 12:39:19.950044 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:19.949747    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s228p" event={"ID":"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e","Type":"ContainerDied","Data":"3726c047484cd10f47486d7f6e90d842ea87d7c1ab13b0b498c1735f30944622"}
Jul 02 12:39:20.701024 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:20.700958    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:20.701024 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:20.701021    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:20.701202 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:20.701117    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:20.701202 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:20.701161    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:20.701288 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:20.701263    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:20.701404 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:20.701384    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:20.954906 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:20.954861    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s228p" event={"ID":"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e","Type":"ContainerStarted","Data":"beaad81a8ee18cc1522f50ea1d3d5ce4685103d54cd9641ad896d926be654d64"}
Jul 02 12:39:21.958245 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:21.958215    2560 generic.go:356] "Generic (PLEG): container finished" podID="734fdd4c-fc93-4f2e-bdea-b7d72b2d646e" containerID="beaad81a8ee18cc1522f50ea1d3d5ce4685103d54cd9641ad896d926be654d64" exitCode=0
Jul 02 12:39:21.958585 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:21.958248    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s228p" event={"ID":"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e","Type":"ContainerDied","Data":"beaad81a8ee18cc1522f50ea1d3d5ce4685103d54cd9641ad896d926be654d64"}
Jul 02 12:39:22.508081 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:22.508049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:22.508225 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:22.508092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:22.508225 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:22.508140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnxh9\" (UniqueName: \"kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9\") pod \"network-check-target-dhszc\" (UID: \"a40b3102-c663-4d18-b41b-84c6ae90d57c\") " pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:22.508225 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:22.508196    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 12:39:22.508469 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:22.508229    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 12:39:22.508469 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:22.508246    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 12:39:22.508469 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:22.508259    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nnxh9 for pod openshift-network-diagnostics/network-check-target-dhszc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:39:22.508469 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:22.508280    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:39:22.508469 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:22.508260    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret podName:ba57525a-aa69-48d0-a51b-d631b1fde187 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:54.508242556 +0000 UTC m=+65.240502956 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret") pod "global-pull-secret-syncer-sw5dm" (UID: "ba57525a-aa69-48d0-a51b-d631b1fde187") : object "kube-system"/"original-pull-secret" not registered
Jul 02 12:39:22.508469 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:22.508355    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9 podName:a40b3102-c663-4d18-b41b-84c6ae90d57c nodeName:}" failed. No retries permitted until 2026-07-02 12:39:54.508336364 +0000 UTC m=+65.240596750 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nnxh9" (UniqueName: "kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9") pod "network-check-target-dhszc" (UID: "a40b3102-c663-4d18-b41b-84c6ae90d57c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 12:39:22.508469 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:22.508372    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs podName:d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc nodeName:}" failed. No retries permitted until 2026-07-02 12:39:54.50836212 +0000 UTC m=+65.240622510 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs") pod "network-metrics-daemon-srq4r" (UID: "d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 12:39:22.700423 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:22.700395    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:22.700595 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:22.700397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:22.700595 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:22.700397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:22.700595 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:22.700527    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dhszc" podUID="a40b3102-c663-4d18-b41b-84c6ae90d57c"
Jul 02 12:39:22.700783 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:22.700616    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sw5dm" podUID="ba57525a-aa69-48d0-a51b-d631b1fde187"
Jul 02 12:39:22.700783 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:22.700710    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-srq4r" podUID="d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc"
Jul 02 12:39:24.116747 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.116716    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-177.ec2.internal" event="NodeReady"
Jul 02 12:39:24.117169 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.116855    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 12:39:24.162487 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.162414    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-597b779bc-ph59l"]
Jul 02 12:39:24.164465 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.164427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.168327 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.168269    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 12:39:24.168970 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.168923    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 12:39:24.168970 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.168934    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 12:39:24.169130 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.168999    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rs2lw\""
Jul 02 12:39:24.174543 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.174517    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 12:39:24.182353 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.182336    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-snlz4"]
Jul 02 12:39:24.187112 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.187095    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n9b25"]
Jul 02 12:39:24.187330 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.187220    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-snlz4"
Jul 02 12:39:24.189941 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.189903    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4g4pc\""
Jul 02 12:39:24.190298 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.190228    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 12:39:24.190298 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.190232    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 12:39:24.190459 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.190325    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 12:39:24.190998 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.190981    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-597b779bc-ph59l"]
Jul 02 12:39:24.191140 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.191076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.194046 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.194028    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 12:39:24.194175 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.194152    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5qtp9\""
Jul 02 12:39:24.194175 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.194165    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 12:39:24.204186 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.204131    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n9b25"]
Jul 02 12:39:24.204968 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.204946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-snlz4"]
Jul 02 12:39:24.304322 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.304297    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lwl5h"]
Jul 02 12:39:24.306413 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.306390    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.306701 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.306683    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474"]
Jul 02 12:39:24.308452 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.308416    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474"
Jul 02 12:39:24.313822 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.313804    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 02 12:39:24.318555 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.315810    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 12:39:24.318555 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.315849    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 02 12:39:24.318555 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.315873    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 12:39:24.318555 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.315888    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 12:39:24.318555 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.316873    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kzvtc\""
Jul 02 12:39:24.318555 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.316971    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 12:39:24.318555 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.316992    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2v59p\""
Jul 02 12:39:24.323377 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323357    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-image-registry-private-configuration\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.323505 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323390    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.323505 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.323505 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ff563c8-df8e-47f7-a1e0-07e375994964-ca-trust-extracted\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.323655 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dvsb\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-kube-api-access-5dvsb\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.323655 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323584    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82e35c4f-943a-409c-97b6-bae9430d9e00-tmp-dir\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.323747 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323670    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4d2n\" (UniqueName: \"kubernetes.io/projected/82e35c4f-943a-409c-97b6-bae9430d9e00-kube-api-access-p4d2n\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.323747 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62852525-9ae2-46c5-8b60-27242d35ec23-cert\") pod \"ingress-canary-snlz4\" (UID: \"62852525-9ae2-46c5-8b60-27242d35ec23\") " pod="openshift-ingress-canary/ingress-canary-snlz4"
Jul 02 12:39:24.323841 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323745    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-certificates\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.323841 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bzrq\" (UniqueName: \"kubernetes.io/projected/62852525-9ae2-46c5-8b60-27242d35ec23-kube-api-access-9bzrq\") pod \"ingress-canary-snlz4\" (UID: \"62852525-9ae2-46c5-8b60-27242d35ec23\") " pod="openshift-ingress-canary/ingress-canary-snlz4"
Jul 02 12:39:24.323841 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-installation-pull-secrets\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.323947 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82e35c4f-943a-409c-97b6-bae9430d9e00-config-volume\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.323947 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-trusted-ca\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.323947 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.323908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-bound-sa-token\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.334505 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.334482    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474"]
Jul 02 12:39:24.334935 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.334911    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lwl5h"]
Jul 02 12:39:24.424250 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82e35c4f-943a-409c-97b6-bae9430d9e00-tmp-dir\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.424250 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424240    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4d2n\" (UniqueName: \"kubernetes.io/projected/82e35c4f-943a-409c-97b6-bae9430d9e00-kube-api-access-p4d2n\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.424494 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62852525-9ae2-46c5-8b60-27242d35ec23-cert\") pod \"ingress-canary-snlz4\" (UID: \"62852525-9ae2-46c5-8b60-27242d35ec23\") " pod="openshift-ingress-canary/ingress-canary-snlz4"
Jul 02 12:39:24.424567 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-certificates\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.424567 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzrq\" (UniqueName: \"kubernetes.io/projected/62852525-9ae2-46c5-8b60-27242d35ec23-kube-api-access-9bzrq\") pod \"ingress-canary-snlz4\" (UID: \"62852525-9ae2-46c5-8b60-27242d35ec23\") " pod="openshift-ingress-canary/ingress-canary-snlz4"
Jul 02 12:39:24.424661 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-installation-pull-secrets\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.424661 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.424661 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82e35c4f-943a-409c-97b6-bae9430d9e00-config-volume\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.424809 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-trusted-ca\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.424809 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/183c86a9-263c-45d5-90ba-f694ecad4315-data-volume\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.424809 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424746    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-bound-sa-token\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.424809 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9nds\" (UniqueName: \"kubernetes.io/projected/183c86a9-263c-45d5-90ba-f694ecad4315-kube-api-access-b9nds\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.425008 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424814    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82e35c4f-943a-409c-97b6-bae9430d9e00-tmp-dir\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.425008 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-image-registry-private-configuration\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.425008 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.425008 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.425008 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q794c\" (UniqueName: \"kubernetes.io/projected/639273cb-e29e-417c-9e8f-2c03a72bca82-kube-api-access-q794c\") pod \"migrator-786f9fbc5-ms474\" (UID: \"639273cb-e29e-417c-9e8f-2c03a72bca82\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474"
Jul 02 12:39:24.425008 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.425008 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ff563c8-df8e-47f7-a1e0-07e375994964-ca-trust-extracted\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.425008 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.424994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dvsb\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-kube-api-access-5dvsb\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.425394 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.425041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/183c86a9-263c-45d5-90ba-f694ecad4315-crio-socket\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.425394 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.425091    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-certificates\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.425394 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.425180    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 12:39:24.425394 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.425195    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597b779bc-ph59l: secret "image-registry-tls" not found
Jul 02 12:39:24.425394 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.425243    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls podName:7ff563c8-df8e-47f7-a1e0-07e375994964 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:24.925227156 +0000 UTC m=+35.657487562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls") pod "image-registry-597b779bc-ph59l" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964") : secret "image-registry-tls" not found
Jul 02 12:39:24.425394 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.425256    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82e35c4f-943a-409c-97b6-bae9430d9e00-config-volume\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.425394 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.425320    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 12:39:24.425394 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.425355    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls podName:82e35c4f-943a-409c-97b6-bae9430d9e00 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:24.925343306 +0000 UTC m=+35.657603701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls") pod "dns-default-n9b25" (UID: "82e35c4f-943a-409c-97b6-bae9430d9e00") : secret "dns-default-metrics-tls" not found
Jul 02 12:39:24.425799 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.425776    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ff563c8-df8e-47f7-a1e0-07e375994964-ca-trust-extracted\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.425921 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.425899    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-trusted-ca\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.429287 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.429268    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-installation-pull-secrets\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.429369 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.429311    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-image-registry-private-configuration\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.429369 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.429342    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62852525-9ae2-46c5-8b60-27242d35ec23-cert\") pod \"ingress-canary-snlz4\" (UID: \"62852525-9ae2-46c5-8b60-27242d35ec23\") " pod="openshift-ingress-canary/ingress-canary-snlz4"
Jul 02 12:39:24.434772 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.434732    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4d2n\" (UniqueName: \"kubernetes.io/projected/82e35c4f-943a-409c-97b6-bae9430d9e00-kube-api-access-p4d2n\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.436469 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.436425    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bzrq\" (UniqueName: \"kubernetes.io/projected/62852525-9ae2-46c5-8b60-27242d35ec23-kube-api-access-9bzrq\") pod \"ingress-canary-snlz4\" (UID: \"62852525-9ae2-46c5-8b60-27242d35ec23\") " pod="openshift-ingress-canary/ingress-canary-snlz4"
Jul 02 12:39:24.436694 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.436670    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dvsb\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-kube-api-access-5dvsb\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.436799 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.436780    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-bound-sa-token\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.498855 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.498825    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-snlz4"
Jul 02 12:39:24.526101 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.526079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.526183 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.526107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/183c86a9-263c-45d5-90ba-f694ecad4315-data-volume\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.526183 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.526129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9nds\" (UniqueName: \"kubernetes.io/projected/183c86a9-263c-45d5-90ba-f694ecad4315-kube-api-access-b9nds\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.526280 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.526211    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 12:39:24.526280 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.526258    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.526379 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.526295    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm podName:183c86a9-263c-45d5-90ba-f694ecad4315 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:25.026274142 +0000 UTC m=+35.758534539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwl5h" (UID: "183c86a9-263c-45d5-90ba-f694ecad4315") : configmap "kube-rbac-proxy" not found
Jul 02 12:39:24.526379 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.526329    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q794c\" (UniqueName: \"kubernetes.io/projected/639273cb-e29e-417c-9e8f-2c03a72bca82-kube-api-access-q794c\") pod \"migrator-786f9fbc5-ms474\" (UID: \"639273cb-e29e-417c-9e8f-2c03a72bca82\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474"
Jul 02 12:39:24.526379 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.526345    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 12:39:24.526542 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.526393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/183c86a9-263c-45d5-90ba-f694ecad4315-crio-socket\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.526542 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.526399    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls podName:183c86a9-263c-45d5-90ba-f694ecad4315 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:25.026387282 +0000 UTC m=+35.758647672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwl5h" (UID: "183c86a9-263c-45d5-90ba-f694ecad4315") : secret "insights-runtime-extractor-tls" not found
Jul 02 12:39:24.526542 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.526427    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/183c86a9-263c-45d5-90ba-f694ecad4315-data-volume\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.526674 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.526616    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/183c86a9-263c-45d5-90ba-f694ecad4315-crio-socket\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.537386 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.537359    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q794c\" (UniqueName: \"kubernetes.io/projected/639273cb-e29e-417c-9e8f-2c03a72bca82-kube-api-access-q794c\") pod \"migrator-786f9fbc5-ms474\" (UID: \"639273cb-e29e-417c-9e8f-2c03a72bca82\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474"
Jul 02 12:39:24.537980 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.537958    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9nds\" (UniqueName: \"kubernetes.io/projected/183c86a9-263c-45d5-90ba-f694ecad4315-kube-api-access-b9nds\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:24.623633 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.623610    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474"
Jul 02 12:39:24.701054 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.700990    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:24.701173 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.701139    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:24.701230 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.701175    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:24.704345 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.704303    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwrzl\""
Jul 02 12:39:24.704494 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.704356    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 12:39:24.704494 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.704393    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mgbjz\""
Jul 02 12:39:24.704654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.704559    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 12:39:24.704654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.704569    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 12:39:24.704654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.704631    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 12:39:24.929214 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.929184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:24.929365 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:24.929230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:24.929365 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.929323    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 12:39:24.929365 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.929339    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 12:39:24.929365 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.929353    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597b779bc-ph59l: secret "image-registry-tls" not found
Jul 02 12:39:24.929554 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.929380    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls podName:82e35c4f-943a-409c-97b6-bae9430d9e00 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:25.929363239 +0000 UTC m=+36.661623625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls") pod "dns-default-n9b25" (UID: "82e35c4f-943a-409c-97b6-bae9430d9e00") : secret "dns-default-metrics-tls" not found
Jul 02 12:39:24.929554 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:24.929470    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls podName:7ff563c8-df8e-47f7-a1e0-07e375994964 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:25.929447383 +0000 UTC m=+36.661707783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls") pod "image-registry-597b779bc-ph59l" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964") : secret "image-registry-tls" not found
Jul 02 12:39:25.030120 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:25.030046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:25.030258 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:25.030137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:25.030258 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:25.030193    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 12:39:25.030258 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:25.030219    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 12:39:25.030396 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:25.030265    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls podName:183c86a9-263c-45d5-90ba-f694ecad4315 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:26.030246313 +0000 UTC m=+36.762506704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwl5h" (UID: "183c86a9-263c-45d5-90ba-f694ecad4315") : secret "insights-runtime-extractor-tls" not found
Jul 02 12:39:25.030396 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:25.030282    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm podName:183c86a9-263c-45d5-90ba-f694ecad4315 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:26.030275174 +0000 UTC m=+36.762535561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwl5h" (UID: "183c86a9-263c-45d5-90ba-f694ecad4315") : configmap "kube-rbac-proxy" not found
Jul 02 12:39:25.872353 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:25.871978    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-drc6k_ead7f268-0162-428f-9cf4-f72141d2c2f3/dns-node-resolver/0.log"
Jul 02 12:39:25.937134 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:25.936992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:25.937134 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:25.937124    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 12:39:25.937134 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:25.937139    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597b779bc-ph59l: secret "image-registry-tls" not found
Jul 02 12:39:25.937320 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:25.937173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:25.937320 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:25.937194    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls podName:7ff563c8-df8e-47f7-a1e0-07e375994964 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:27.937174763 +0000 UTC m=+38.669435149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls") pod "image-registry-597b779bc-ph59l" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964") : secret "image-registry-tls" not found
Jul 02 12:39:25.937320 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:25.937266    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 12:39:25.937505 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:25.937324    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls podName:82e35c4f-943a-409c-97b6-bae9430d9e00 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:27.937308284 +0000 UTC m=+38.669568691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls") pod "dns-default-n9b25" (UID: "82e35c4f-943a-409c-97b6-bae9430d9e00") : secret "dns-default-metrics-tls" not found
Jul 02 12:39:25.949426 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:25.949403    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-snlz4"]
Jul 02 12:39:25.953543 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:25.953145    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474"]
Jul 02 12:39:25.967975 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:25.967954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-snlz4" event={"ID":"62852525-9ae2-46c5-8b60-27242d35ec23","Type":"ContainerStarted","Data":"946314fd51b1be4fbed6cab828dfe1750fd6f002e052a5cb536fe2e6c9522286"}
Jul 02 12:39:25.970934 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:25.970911    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s228p" event={"ID":"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e","Type":"ContainerStarted","Data":"e44cf4d19f24cafd86cc6e0ad1cabf7352c9c6ddb71866be800835db58d0ee67"}
Jul 02 12:39:25.972247 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:25.972225    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474" event={"ID":"639273cb-e29e-417c-9e8f-2c03a72bca82","Type":"ContainerStarted","Data":"390ddfcac18fd5fdd8ac69a0e6a74b5a799735f3888a23d0da79eeaea08c54d0"}
Jul 02 12:39:26.038310 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:26.038287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:26.038424 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:26.038342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:26.038424 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:26.038415    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 12:39:26.038551 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:26.038444    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 12:39:26.038551 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:26.038504    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm podName:183c86a9-263c-45d5-90ba-f694ecad4315 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:28.038484006 +0000 UTC m=+38.770744398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwl5h" (UID: "183c86a9-263c-45d5-90ba-f694ecad4315") : configmap "kube-rbac-proxy" not found
Jul 02 12:39:26.038551 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:26.038526    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls podName:183c86a9-263c-45d5-90ba-f694ecad4315 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:28.038515852 +0000 UTC m=+38.770776238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwl5h" (UID: "183c86a9-263c-45d5-90ba-f694ecad4315") : secret "insights-runtime-extractor-tls" not found
Jul 02 12:39:26.982112 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:26.982063    2560 generic.go:356] "Generic (PLEG): container finished" podID="734fdd4c-fc93-4f2e-bdea-b7d72b2d646e" containerID="e44cf4d19f24cafd86cc6e0ad1cabf7352c9c6ddb71866be800835db58d0ee67" exitCode=0
Jul 02 12:39:26.982668 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:26.982119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s228p" event={"ID":"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e","Type":"ContainerDied","Data":"e44cf4d19f24cafd86cc6e0ad1cabf7352c9c6ddb71866be800835db58d0ee67"}
Jul 02 12:39:27.068990 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:27.068969    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tq8xq_ca69c8d9-e134-41f9-98fb-52721bed505f/node-ca/0.log"
Jul 02 12:39:27.953677 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:27.953644    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:27.953849 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:27.953700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:27.953849 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:27.953792    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 12:39:27.953950 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:27.953860    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls podName:82e35c4f-943a-409c-97b6-bae9430d9e00 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:31.953845029 +0000 UTC m=+42.686105416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls") pod "dns-default-n9b25" (UID: "82e35c4f-943a-409c-97b6-bae9430d9e00") : secret "dns-default-metrics-tls" not found
Jul 02 12:39:27.953950 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:27.953795    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 12:39:27.953950 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:27.953891    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597b779bc-ph59l: secret "image-registry-tls" not found
Jul 02 12:39:27.953950 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:27.953947    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls podName:7ff563c8-df8e-47f7-a1e0-07e375994964 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:31.953931961 +0000 UTC m=+42.686192354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls") pod "image-registry-597b779bc-ph59l" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964") : secret "image-registry-tls" not found
Jul 02 12:39:27.988045 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:27.988016    2560 generic.go:356] "Generic (PLEG): container finished" podID="734fdd4c-fc93-4f2e-bdea-b7d72b2d646e" containerID="2d85880cbeda50a1310a8d86690b48f2feecb5352738ed1a0c3d9475929bcdbb" exitCode=0
Jul 02 12:39:27.988450 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:27.988087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s228p" event={"ID":"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e","Type":"ContainerDied","Data":"2d85880cbeda50a1310a8d86690b48f2feecb5352738ed1a0c3d9475929bcdbb"}
Jul 02 12:39:28.054263 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:28.054234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:28.054394 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:28.054314    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 12:39:28.054394 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:28.054320    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:28.054394 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:28.054368    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm podName:183c86a9-263c-45d5-90ba-f694ecad4315 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:32.05435153 +0000 UTC m=+42.786611931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwl5h" (UID: "183c86a9-263c-45d5-90ba-f694ecad4315") : configmap "kube-rbac-proxy" not found
Jul 02 12:39:28.054555 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:28.054477    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 12:39:28.054555 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:28.054540    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls podName:183c86a9-263c-45d5-90ba-f694ecad4315 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:32.054523173 +0000 UTC m=+42.786783564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwl5h" (UID: "183c86a9-263c-45d5-90ba-f694ecad4315") : secret "insights-runtime-extractor-tls" not found
Jul 02 12:39:28.993343 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:28.993312    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s228p" event={"ID":"734fdd4c-fc93-4f2e-bdea-b7d72b2d646e","Type":"ContainerStarted","Data":"36cb37b35acdb860756f9071f38bcf05b01f1a8e636643e3f0647efe3226d9c6"}
Jul 02 12:39:28.994959 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:28.994931    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474" event={"ID":"639273cb-e29e-417c-9e8f-2c03a72bca82","Type":"ContainerStarted","Data":"b58138913c648caa47018d2e82291f8b9d08aa6109e463eefcb3cd1566379681"}
Jul 02 12:39:28.995077 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:28.994989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474" event={"ID":"639273cb-e29e-417c-9e8f-2c03a72bca82","Type":"ContainerStarted","Data":"008371edadc57be9e66e86b56752e0a071bb225d4a67e8901e435a4e342f8f6e"}
Jul 02 12:39:28.996266 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:28.996242    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-snlz4" event={"ID":"62852525-9ae2-46c5-8b60-27242d35ec23","Type":"ContainerStarted","Data":"e6cdcdf1de92a55c0c4d0e2b546821435af62c5083aff20f634c583b9cce60c5"}
Jul 02 12:39:29.039249 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:29.039209    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s228p" podStartSLOduration=8.741642575 podStartE2EDuration="39.039197397s" totalImagesPullingTime="30.297554822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:29.03397929 +0000 UTC m=+39.766239726" watchObservedRunningTime="2026-07-02 12:39:29.039197397 +0000 UTC m=+39.771457805"
Jul 02 12:39:29.062709 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:29.062673    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-snlz4" podStartSLOduration=2.319032763 podStartE2EDuration="5.062661038s" totalImagesPullingTime="2.743628275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:29.061629729 +0000 UTC m=+39.793890138" watchObservedRunningTime="2026-07-02 12:39:29.062661038 +0000 UTC m=+39.794921446"
Jul 02 12:39:29.084450 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:29.084399    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-ms474" podStartSLOduration=2.355848107 podStartE2EDuration="5.084388622s" totalImagesPullingTime="2.728540515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:29.080842668 +0000 UTC m=+39.813103078" watchObservedRunningTime="2026-07-02 12:39:29.084388622 +0000 UTC m=+39.816649050"
Jul 02 12:39:31.981383 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:31.981348    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:31.981829 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:31.981392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:31.981829 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:31.981507    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 12:39:31.981829 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:31.981572    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls podName:82e35c4f-943a-409c-97b6-bae9430d9e00 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:39.981554581 +0000 UTC m=+50.713814973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls") pod "dns-default-n9b25" (UID: "82e35c4f-943a-409c-97b6-bae9430d9e00") : secret "dns-default-metrics-tls" not found
Jul 02 12:39:31.981829 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:31.981508    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 12:39:31.981829 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:31.981607    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-597b779bc-ph59l: secret "image-registry-tls" not found
Jul 02 12:39:31.981829 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:31.981651    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls podName:7ff563c8-df8e-47f7-a1e0-07e375994964 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:39.981637961 +0000 UTC m=+50.713898347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls") pod "image-registry-597b779bc-ph59l" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964") : secret "image-registry-tls" not found
Jul 02 12:39:32.081793 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:32.081769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:32.081882 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:32.081819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:32.081916 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:32.081887    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 12:39:32.081946 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:32.081924    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls podName:183c86a9-263c-45d5-90ba-f694ecad4315 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:40.081914493 +0000 UTC m=+50.814174880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwl5h" (UID: "183c86a9-263c-45d5-90ba-f694ecad4315") : secret "insights-runtime-extractor-tls" not found
Jul 02 12:39:32.082253 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:32.082237    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/183c86a9-263c-45d5-90ba-f694ecad4315-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:40.033763 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.033729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:40.034252 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.033773    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:40.037197 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.037174    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82e35c4f-943a-409c-97b6-bae9430d9e00-metrics-tls\") pod \"dns-default-n9b25\" (UID: \"82e35c4f-943a-409c-97b6-bae9430d9e00\") " pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:40.037330 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.037312    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls\") pod \"image-registry-597b779bc-ph59l\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") " pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:40.075173 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.075151    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:40.105824 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.105791    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:40.134159 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.134133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:40.136606 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.136580    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/183c86a9-263c-45d5-90ba-f694ecad4315-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwl5h\" (UID: \"183c86a9-263c-45d5-90ba-f694ecad4315\") " pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:40.216842 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.216813    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lwl5h"
Jul 02 12:39:40.235474 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.235424    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-597b779bc-ph59l"]
Jul 02 12:39:40.238295 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:39:40.238273    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff563c8_df8e_47f7_a1e0_07e375994964.slice/crio-9575891c88712432072986dc1e2fec3e221e4958ac3c02ad3f8335951f2fe71e WatchSource:0}: Error finding container 9575891c88712432072986dc1e2fec3e221e4958ac3c02ad3f8335951f2fe71e: Status 404 returned error can't find the container with id 9575891c88712432072986dc1e2fec3e221e4958ac3c02ad3f8335951f2fe71e
Jul 02 12:39:40.255860 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.255837    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n9b25"]
Jul 02 12:39:40.258241 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:39:40.258206    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e35c4f_943a_409c_97b6_bae9430d9e00.slice/crio-8c38f76f4b0f4a84736922575697cda5d8454d08f5bef4438f7fde24787cfd28 WatchSource:0}: Error finding container 8c38f76f4b0f4a84736922575697cda5d8454d08f5bef4438f7fde24787cfd28: Status 404 returned error can't find the container with id 8c38f76f4b0f4a84736922575697cda5d8454d08f5bef4438f7fde24787cfd28
Jul 02 12:39:40.379260 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:40.379235    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lwl5h"]
Jul 02 12:39:40.382044 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:39:40.382012    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183c86a9_263c_45d5_90ba_f694ecad4315.slice/crio-5e5d02ffbeb436f9de051e86d69a44d2e41ee19d274debf232756e2dddda4a90 WatchSource:0}: Error finding container 5e5d02ffbeb436f9de051e86d69a44d2e41ee19d274debf232756e2dddda4a90: Status 404 returned error can't find the container with id 5e5d02ffbeb436f9de051e86d69a44d2e41ee19d274debf232756e2dddda4a90
Jul 02 12:39:41.027137 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:41.026686    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597b779bc-ph59l" event={"ID":"7ff563c8-df8e-47f7-a1e0-07e375994964","Type":"ContainerStarted","Data":"795a138466a9bd898e6f51757a7bfc37d47001e6f11e8658959a6d98b0071fb4"}
Jul 02 12:39:41.027137 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:41.026751    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597b779bc-ph59l" event={"ID":"7ff563c8-df8e-47f7-a1e0-07e375994964","Type":"ContainerStarted","Data":"9575891c88712432072986dc1e2fec3e221e4958ac3c02ad3f8335951f2fe71e"}
Jul 02 12:39:41.027137 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:41.026788    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:39:41.028758 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:41.028726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n9b25" event={"ID":"82e35c4f-943a-409c-97b6-bae9430d9e00","Type":"ContainerStarted","Data":"8c38f76f4b0f4a84736922575697cda5d8454d08f5bef4438f7fde24787cfd28"}
Jul 02 12:39:41.030330 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:41.030241    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwl5h" event={"ID":"183c86a9-263c-45d5-90ba-f694ecad4315","Type":"ContainerStarted","Data":"5e5d02ffbeb436f9de051e86d69a44d2e41ee19d274debf232756e2dddda4a90"}
Jul 02 12:39:41.048188 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:41.047888    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-597b779bc-ph59l" podStartSLOduration=46.047869037 podStartE2EDuration="46.047869037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:41.046287809 +0000 UTC m=+51.778548220" watchObservedRunningTime="2026-07-02 12:39:41.047869037 +0000 UTC m=+51.780129447"
Jul 02 12:39:45.043922 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:45.043879    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwl5h" event={"ID":"183c86a9-263c-45d5-90ba-f694ecad4315","Type":"ContainerStarted","Data":"f306bfd5635395a6eeab66b08438de4328fe83d264cbc44bb4dbf9b6cbda84a0"}
Jul 02 12:39:45.045650 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:45.045626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n9b25" event={"ID":"82e35c4f-943a-409c-97b6-bae9430d9e00","Type":"ContainerStarted","Data":"41091b8e40db1d3e55f30cd1b6f30c98aca0564380f43fd6236c3a12506c7d61"}
Jul 02 12:39:45.045789 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:45.045673    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n9b25" event={"ID":"82e35c4f-943a-409c-97b6-bae9430d9e00","Type":"ContainerStarted","Data":"23b66f652163b1d1f986f649b0db56cad427b49dba42b4f5676afc92d5577ad0"}
Jul 02 12:39:45.045789 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:45.045739    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:46.051197 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:46.051160    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwl5h" event={"ID":"183c86a9-263c-45d5-90ba-f694ecad4315","Type":"ContainerStarted","Data":"d145e39cc416c7c1396c9d3ab5db6b8c85a5c02b1ea3fa50904cc44b486b8059"}
Jul 02 12:39:48.059469 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:48.059386    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwl5h" event={"ID":"183c86a9-263c-45d5-90ba-f694ecad4315","Type":"ContainerStarted","Data":"51cfda8671f060721249bb132fdbf2a7070aa4a38462d9f5e4984e7a111ef3d1"}
Jul 02 12:39:48.089299 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:48.089256    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n9b25" podStartSLOduration=19.772948242 podStartE2EDuration="24.08924329s" totalImagesPullingTime="4.316295048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:45.067490831 +0000 UTC m=+55.799751265" watchObservedRunningTime="2026-07-02 12:39:48.08924329 +0000 UTC m=+58.821503676"
Jul 02 12:39:49.879224 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:49.879167    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lwl5h" podStartSLOduration=18.699539096 podStartE2EDuration="25.879146274s" totalImagesPullingTime="7.179607178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:39:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:48.091290571 +0000 UTC m=+58.823550981" watchObservedRunningTime="2026-07-02 12:39:49.879146274 +0000 UTC m=+60.611406683"
Jul 02 12:39:49.879585 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:49.879548    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"]
Jul 02 12:39:49.911448 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:49.911405    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"]
Jul 02 12:39:49.911560 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:49.911514    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:49.914880 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:49.914862    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 12:39:49.915124 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:49.915108    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 12:39:49.915350 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:49.915337    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 12:39:49.916253 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:49.916207    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 12:39:49.940790 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:49.940767    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-597b779bc-ph59l"]
Jul 02 12:39:50.001472 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.001452    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4f5e020-a7e6-448e-8de6-e66cd9e8a250-tmp\") pod \"klusterlet-addon-workmgr-b84b84954-khwfs\" (UID: \"e4f5e020-a7e6-448e-8de6-e66cd9e8a250\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:50.001567 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.001481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmzq5\" (UniqueName: \"kubernetes.io/projected/e4f5e020-a7e6-448e-8de6-e66cd9e8a250-kube-api-access-nmzq5\") pod \"klusterlet-addon-workmgr-b84b84954-khwfs\" (UID: \"e4f5e020-a7e6-448e-8de6-e66cd9e8a250\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:50.001567 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.001501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4f5e020-a7e6-448e-8de6-e66cd9e8a250-klusterlet-config\") pod \"klusterlet-addon-workmgr-b84b84954-khwfs\" (UID: \"e4f5e020-a7e6-448e-8de6-e66cd9e8a250\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:50.014631 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.014610    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75755fbc89-7h7vm"]
Jul 02 12:39:50.029876 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.029858    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.043373 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.043353    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75755fbc89-7h7vm"]
Jul 02 12:39:50.102094 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4k4c\" (UniqueName: \"kubernetes.io/projected/5eb82eb9-e022-4de7-96ca-f2c690a41de1-kube-api-access-m4k4c\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.102190 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5eb82eb9-e022-4de7-96ca-f2c690a41de1-trusted-ca\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.102190 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5eb82eb9-e022-4de7-96ca-f2c690a41de1-bound-sa-token\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.102190 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmzq5\" (UniqueName: \"kubernetes.io/projected/e4f5e020-a7e6-448e-8de6-e66cd9e8a250-kube-api-access-nmzq5\") pod \"klusterlet-addon-workmgr-b84b84954-khwfs\" (UID: \"e4f5e020-a7e6-448e-8de6-e66cd9e8a250\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:50.102190 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5eb82eb9-e022-4de7-96ca-f2c690a41de1-registry-certificates\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.102190 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5eb82eb9-e022-4de7-96ca-f2c690a41de1-registry-tls\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.102404 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5eb82eb9-e022-4de7-96ca-f2c690a41de1-ca-trust-extracted\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.102404 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5eb82eb9-e022-4de7-96ca-f2c690a41de1-installation-pull-secrets\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.102404 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102335    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5eb82eb9-e022-4de7-96ca-f2c690a41de1-image-registry-private-configuration\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.102585 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4f5e020-a7e6-448e-8de6-e66cd9e8a250-tmp\") pod \"klusterlet-addon-workmgr-b84b84954-khwfs\" (UID: \"e4f5e020-a7e6-448e-8de6-e66cd9e8a250\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:50.102585 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4f5e020-a7e6-448e-8de6-e66cd9e8a250-klusterlet-config\") pod \"klusterlet-addon-workmgr-b84b84954-khwfs\" (UID: \"e4f5e020-a7e6-448e-8de6-e66cd9e8a250\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:50.102749 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.102730    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4f5e020-a7e6-448e-8de6-e66cd9e8a250-tmp\") pod \"klusterlet-addon-workmgr-b84b84954-khwfs\" (UID: \"e4f5e020-a7e6-448e-8de6-e66cd9e8a250\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:50.104820 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.104800    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e4f5e020-a7e6-448e-8de6-e66cd9e8a250-klusterlet-config\") pod \"klusterlet-addon-workmgr-b84b84954-khwfs\" (UID: \"e4f5e020-a7e6-448e-8de6-e66cd9e8a250\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:50.117865 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.117837    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmzq5\" (UniqueName: \"kubernetes.io/projected/e4f5e020-a7e6-448e-8de6-e66cd9e8a250-kube-api-access-nmzq5\") pod \"klusterlet-addon-workmgr-b84b84954-khwfs\" (UID: \"e4f5e020-a7e6-448e-8de6-e66cd9e8a250\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:50.203455 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.203390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4k4c\" (UniqueName: \"kubernetes.io/projected/5eb82eb9-e022-4de7-96ca-f2c690a41de1-kube-api-access-m4k4c\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.203455 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.203416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5eb82eb9-e022-4de7-96ca-f2c690a41de1-trusted-ca\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.203455 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.203448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5eb82eb9-e022-4de7-96ca-f2c690a41de1-bound-sa-token\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.203649 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.203472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5eb82eb9-e022-4de7-96ca-f2c690a41de1-registry-certificates\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.203649 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.203491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5eb82eb9-e022-4de7-96ca-f2c690a41de1-registry-tls\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.203741 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.203639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5eb82eb9-e022-4de7-96ca-f2c690a41de1-ca-trust-extracted\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.203741 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.203673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5eb82eb9-e022-4de7-96ca-f2c690a41de1-installation-pull-secrets\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.203741 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.203710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5eb82eb9-e022-4de7-96ca-f2c690a41de1-image-registry-private-configuration\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.204032 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.204008    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5eb82eb9-e022-4de7-96ca-f2c690a41de1-ca-trust-extracted\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.204347 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.204323    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5eb82eb9-e022-4de7-96ca-f2c690a41de1-registry-certificates\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.204458 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.204375    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5eb82eb9-e022-4de7-96ca-f2c690a41de1-trusted-ca\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.205723 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.205703    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5eb82eb9-e022-4de7-96ca-f2c690a41de1-registry-tls\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.205958 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.205925    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5eb82eb9-e022-4de7-96ca-f2c690a41de1-image-registry-private-configuration\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.206082 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.206067    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5eb82eb9-e022-4de7-96ca-f2c690a41de1-installation-pull-secrets\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.217214 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.217196    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4k4c\" (UniqueName: \"kubernetes.io/projected/5eb82eb9-e022-4de7-96ca-f2c690a41de1-kube-api-access-m4k4c\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.218529 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.218503    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5eb82eb9-e022-4de7-96ca-f2c690a41de1-bound-sa-token\") pod \"image-registry-75755fbc89-7h7vm\" (UID: \"5eb82eb9-e022-4de7-96ca-f2c690a41de1\") " pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.220335 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.220316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:50.337854 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.337826    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:50.366488 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.366416    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"]
Jul 02 12:39:50.368719 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:39:50.368691    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f5e020_a7e6_448e_8de6_e66cd9e8a250.slice/crio-5c147e618a6349db19d06ee8a857452e677465c542adfe47689c06fd4c50766e WatchSource:0}: Error finding container 5c147e618a6349db19d06ee8a857452e677465c542adfe47689c06fd4c50766e: Status 404 returned error can't find the container with id 5c147e618a6349db19d06ee8a857452e677465c542adfe47689c06fd4c50766e
Jul 02 12:39:50.495463 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.495425    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75755fbc89-7h7vm"]
Jul 02 12:39:50.497415 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:39:50.497389    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb82eb9_e022_4de7_96ca_f2c690a41de1.slice/crio-bee3889297feae31117bb72ab682529e0040219d502997ce6445d9dcf443dac1 WatchSource:0}: Error finding container bee3889297feae31117bb72ab682529e0040219d502997ce6445d9dcf443dac1: Status 404 returned error can't find the container with id bee3889297feae31117bb72ab682529e0040219d502997ce6445d9dcf443dac1
Jul 02 12:39:50.965969 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:50.965937    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sv8zr"
Jul 02 12:39:51.069155 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:51.069126    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75755fbc89-7h7vm" event={"ID":"5eb82eb9-e022-4de7-96ca-f2c690a41de1","Type":"ContainerStarted","Data":"c18c15f544f0ad2008d45bb45a7a1a26922fade545c8b3dfccac693dc2b05106"}
Jul 02 12:39:51.069294 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:51.069164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75755fbc89-7h7vm" event={"ID":"5eb82eb9-e022-4de7-96ca-f2c690a41de1","Type":"ContainerStarted","Data":"bee3889297feae31117bb72ab682529e0040219d502997ce6445d9dcf443dac1"}
Jul 02 12:39:51.069294 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:51.069187    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:39:51.070290 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:51.070267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs" event={"ID":"e4f5e020-a7e6-448e-8de6-e66cd9e8a250","Type":"ContainerStarted","Data":"5c147e618a6349db19d06ee8a857452e677465c542adfe47689c06fd4c50766e"}
Jul 02 12:39:51.093100 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:51.093058    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75755fbc89-7h7vm" podStartSLOduration=2.093045672 podStartE2EDuration="2.093045672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:39:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:51.092940261 +0000 UTC m=+61.825200669" watchObservedRunningTime="2026-07-02 12:39:51.093045672 +0000 UTC m=+61.825306081"
Jul 02 12:39:52.072744 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.072702    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw"]
Jul 02 12:39:52.075290 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.075269    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw"
Jul 02 12:39:52.078336 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.078310    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 02 12:39:52.078469 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.078321    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-869s6\""
Jul 02 12:39:52.090409 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.090359    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw"]
Jul 02 12:39:52.119622 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.119291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/09929368-4d9f-4c60-9849-086097d381f7-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-rz2lw\" (UID: \"09929368-4d9f-4c60-9849-086097d381f7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw"
Jul 02 12:39:52.220785 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.220753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/09929368-4d9f-4c60-9849-086097d381f7-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-rz2lw\" (UID: \"09929368-4d9f-4c60-9849-086097d381f7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw"
Jul 02 12:39:52.223909 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.223884    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/09929368-4d9f-4c60-9849-086097d381f7-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-rz2lw\" (UID: \"09929368-4d9f-4c60-9849-086097d381f7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw"
Jul 02 12:39:52.387370 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.387342    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw"
Jul 02 12:39:52.461282 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.461251    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-52k77"]
Jul 02 12:39:52.464458 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.464261    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-52k77"
Jul 02 12:39:52.474780 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:52.474708    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-128-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 02 12:39:52.474780 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:52.474763    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-jcb76\" is forbidden: User \"system:node:ip-10-0-128-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-128-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"default-dockercfg-jcb76\"" type="*v1.Secret"
Jul 02 12:39:52.476641 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:52.476614    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-128-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 02 12:39:52.481937 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:39:52.481898    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"downloads-5499b6fb8f-52k77\" is forbidden: User \"system:node:ip-10-0-128-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-128-177.ec2.internal' and this object" podUID="901f9009-f609-476f-ba60-0a346db71f86" pod="openshift-console/downloads-5499b6fb8f-52k77"
Jul 02 12:39:52.515634 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.515606    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-52k77"]
Jul 02 12:39:52.522380 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.522355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8h6x\" (UniqueName: \"kubernetes.io/projected/901f9009-f609-476f-ba60-0a346db71f86-kube-api-access-d8h6x\") pod \"downloads-5499b6fb8f-52k77\" (UID: \"901f9009-f609-476f-ba60-0a346db71f86\") " pod="openshift-console/downloads-5499b6fb8f-52k77"
Jul 02 12:39:52.562689 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.562657    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw"]
Jul 02 12:39:52.569102 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:39:52.569062    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09929368_4d9f_4c60_9849_086097d381f7.slice/crio-452c31d48fd267101f0fe7c26344c95dc6316368d44685c8e05b5e3edbd48039 WatchSource:0}: Error finding container 452c31d48fd267101f0fe7c26344c95dc6316368d44685c8e05b5e3edbd48039: Status 404 returned error can't find the container with id 452c31d48fd267101f0fe7c26344c95dc6316368d44685c8e05b5e3edbd48039
Jul 02 12:39:52.623010 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:52.622983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8h6x\" (UniqueName: \"kubernetes.io/projected/901f9009-f609-476f-ba60-0a346db71f86-kube-api-access-d8h6x\") pod \"downloads-5499b6fb8f-52k77\" (UID: \"901f9009-f609-476f-ba60-0a346db71f86\") " pod="openshift-console/downloads-5499b6fb8f-52k77"
Jul 02 12:39:53.079273 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:53.079203    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw" event={"ID":"09929368-4d9f-4c60-9849-086097d381f7","Type":"ContainerStarted","Data":"452c31d48fd267101f0fe7c26344c95dc6316368d44685c8e05b5e3edbd48039"}
Jul 02 12:39:53.527582 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:53.527552    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 12:39:54.005284 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.005253    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jcb76\""
Jul 02 12:39:54.024072 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.024050    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 12:39:54.033546 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.033507    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8h6x\" (UniqueName: \"kubernetes.io/projected/901f9009-f609-476f-ba60-0a346db71f86-kube-api-access-d8h6x\") pod \"downloads-5499b6fb8f-52k77\" (UID: \"901f9009-f609-476f-ba60-0a346db71f86\") " pod="openshift-console/downloads-5499b6fb8f-52k77"
Jul 02 12:39:54.274426 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.274350    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-52k77"
Jul 02 12:39:54.540645 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.540566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnxh9\" (UniqueName: \"kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9\") pod \"network-check-target-dhszc\" (UID: \"a40b3102-c663-4d18-b41b-84c6ae90d57c\") " pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:54.540645 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.540634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:54.540852 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.540669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:54.543549 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.543524    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 12:39:54.544540 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.544509    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 12:39:54.544540 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.544534    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 12:39:54.553715 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.553693    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc-metrics-certs\") pod \"network-metrics-daemon-srq4r\" (UID: \"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc\") " pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:54.553809 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.553721    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba57525a-aa69-48d0-a51b-d631b1fde187-original-pull-secret\") pod \"global-pull-secret-syncer-sw5dm\" (UID: \"ba57525a-aa69-48d0-a51b-d631b1fde187\") " pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:54.554077 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.554049    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 12:39:54.563722 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.563701    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnxh9\" (UniqueName: \"kubernetes.io/projected/a40b3102-c663-4d18-b41b-84c6ae90d57c-kube-api-access-nnxh9\") pod \"network-check-target-dhszc\" (UID: \"a40b3102-c663-4d18-b41b-84c6ae90d57c\") " pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:54.713938 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.713905    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sw5dm"
Jul 02 12:39:54.722669 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.722650    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwrzl\""
Jul 02 12:39:54.729921 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.729900    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-srq4r"
Jul 02 12:39:54.730173 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.730154    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mgbjz\""
Jul 02 12:39:54.735353 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:54.735338    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:39:55.058549 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:55.057466    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n9b25"
Jul 02 12:39:55.167065 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:55.166889    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-52k77"]
Jul 02 12:39:55.172735 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:39:55.172687    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901f9009_f609_476f_ba60_0a346db71f86.slice/crio-7e628da8a749895210cae52e01708d1871ec3b0629aa2c8058aa07b0207c16a3 WatchSource:0}: Error finding container 7e628da8a749895210cae52e01708d1871ec3b0629aa2c8058aa07b0207c16a3: Status 404 returned error can't find the container with id 7e628da8a749895210cae52e01708d1871ec3b0629aa2c8058aa07b0207c16a3
Jul 02 12:39:55.193890 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:55.193864    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sw5dm"]
Jul 02 12:39:55.197002 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:39:55.196971    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba57525a_aa69_48d0_a51b_d631b1fde187.slice/crio-ead8bca7b2d858f287a5e133b865335518a718d2c1f5e72912c6676908ec6845 WatchSource:0}: Error finding container ead8bca7b2d858f287a5e133b865335518a718d2c1f5e72912c6676908ec6845: Status 404 returned error can't find the container with id ead8bca7b2d858f287a5e133b865335518a718d2c1f5e72912c6676908ec6845
Jul 02 12:39:55.418380 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:55.418355    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-srq4r"]
Jul 02 12:39:55.420312 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:39:55.420284    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f189e7_80f1_4a4c_8c4a_b05fa6f549cc.slice/crio-1e52103312071662ac8d9922705a2fc0adfaea5e93f6dc1c41f8beba182d8631 WatchSource:0}: Error finding container 1e52103312071662ac8d9922705a2fc0adfaea5e93f6dc1c41f8beba182d8631: Status 404 returned error can't find the container with id 1e52103312071662ac8d9922705a2fc0adfaea5e93f6dc1c41f8beba182d8631
Jul 02 12:39:55.421794 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:55.421767    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dhszc"]
Jul 02 12:39:55.423642 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:39:55.423617    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40b3102_c663_4d18_b41b_84c6ae90d57c.slice/crio-6aba8fade83eb11ab2a122854a40aa2344b48d3ec72ffaa766cb1d6161db635e WatchSource:0}: Error finding container 6aba8fade83eb11ab2a122854a40aa2344b48d3ec72ffaa766cb1d6161db635e: Status 404 returned error can't find the container with id 6aba8fade83eb11ab2a122854a40aa2344b48d3ec72ffaa766cb1d6161db635e
Jul 02 12:39:56.101920 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.101882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-srq4r" event={"ID":"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc","Type":"ContainerStarted","Data":"1e52103312071662ac8d9922705a2fc0adfaea5e93f6dc1c41f8beba182d8631"}
Jul 02 12:39:56.103959 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.103878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dhszc" event={"ID":"a40b3102-c663-4d18-b41b-84c6ae90d57c","Type":"ContainerStarted","Data":"6aba8fade83eb11ab2a122854a40aa2344b48d3ec72ffaa766cb1d6161db635e"}
Jul 02 12:39:56.105895 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.105869    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-52k77" event={"ID":"901f9009-f609-476f-ba60-0a346db71f86","Type":"ContainerStarted","Data":"7e628da8a749895210cae52e01708d1871ec3b0629aa2c8058aa07b0207c16a3"}
Jul 02 12:39:56.108090 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.108019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs" event={"ID":"e4f5e020-a7e6-448e-8de6-e66cd9e8a250","Type":"ContainerStarted","Data":"82bb867ee50d06c1d5eb2fe87fea01a17fa4fe824700aeda294590a8a6ea2e2a"}
Jul 02 12:39:56.108483 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.108357    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:56.110502 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.110472    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs"
Jul 02 12:39:56.110848 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.110801    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sw5dm" event={"ID":"ba57525a-aa69-48d0-a51b-d631b1fde187","Type":"ContainerStarted","Data":"ead8bca7b2d858f287a5e133b865335518a718d2c1f5e72912c6676908ec6845"}
Jul 02 12:39:56.113185 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.113138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw" event={"ID":"09929368-4d9f-4c60-9849-086097d381f7","Type":"ContainerStarted","Data":"af4fde9edfc69fa001d237201484a47c38bd77eb7d20d7f4a6ebf26c89024c8e"}
Jul 02 12:39:56.113379 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.113327    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw"
Jul 02 12:39:56.119546 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.119524    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw"
Jul 02 12:39:56.125809 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.125765    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b84b84954-khwfs" podStartSLOduration=2.493940185 podStartE2EDuration="7.125749107s" totalImagesPullingTime="4.631808922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:56.124863804 +0000 UTC m=+66.857124214" watchObservedRunningTime="2026-07-02 12:39:56.125749107 +0000 UTC m=+66.858009520"
Jul 02 12:39:56.160140 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:56.160080    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-rz2lw" podStartSLOduration=1.731637268 podStartE2EDuration="4.160063365s" totalImagesPullingTime="2.428426097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:56.159580888 +0000 UTC m=+66.891841298" watchObservedRunningTime="2026-07-02 12:39:56.160063365 +0000 UTC m=+66.892323776"
Jul 02 12:39:57.131774 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.130643    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"]
Jul 02 12:39:57.143697 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.143672    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.144536 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.143945    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"]
Jul 02 12:39:57.148988 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.146882    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 12:39:57.148988 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.147168    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 12:39:57.148988 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.147357    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qp9vh\""
Jul 02 12:39:57.148988 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.147556    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 02 12:39:57.148988 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.148160    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 12:39:57.148988 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.148336    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 02 12:39:57.261988 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.261958    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d662f7-9de5-4483-904b-1e95c8af917d-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.262153 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.262022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c6c5\" (UniqueName: \"kubernetes.io/projected/88d662f7-9de5-4483-904b-1e95c8af917d-kube-api-access-5c6c5\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.262153 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.262056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88d662f7-9de5-4483-904b-1e95c8af917d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.262279 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.262162    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88d662f7-9de5-4483-904b-1e95c8af917d-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.362551 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.362516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c6c5\" (UniqueName: \"kubernetes.io/projected/88d662f7-9de5-4483-904b-1e95c8af917d-kube-api-access-5c6c5\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.362705 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.362572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88d662f7-9de5-4483-904b-1e95c8af917d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.362705 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.362629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88d662f7-9de5-4483-904b-1e95c8af917d-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.362705 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.362659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d662f7-9de5-4483-904b-1e95c8af917d-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.363726 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.363363    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88d662f7-9de5-4483-904b-1e95c8af917d-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.366793 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.366746    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/88d662f7-9de5-4483-904b-1e95c8af917d-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.370873 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.370831    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/88d662f7-9de5-4483-904b-1e95c8af917d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.372945 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.372871    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c6c5\" (UniqueName: \"kubernetes.io/projected/88d662f7-9de5-4483-904b-1e95c8af917d-kube-api-access-5c6c5\") pod \"prometheus-operator-7b7d896497-xxbgb\" (UID: \"88d662f7-9de5-4483-904b-1e95c8af917d\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.457764 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.457681    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"
Jul 02 12:39:57.651336 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:57.651305    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-xxbgb"]
Jul 02 12:39:57.654105 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:39:57.653983    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d662f7_9de5_4483_904b_1e95c8af917d.slice/crio-ae3b3bd95236b9fb4bd4ef4cd24d4dfd7eeb0ed909d6c31e63bde9876442801f WatchSource:0}: Error finding container ae3b3bd95236b9fb4bd4ef4cd24d4dfd7eeb0ed909d6c31e63bde9876442801f: Status 404 returned error can't find the container with id ae3b3bd95236b9fb4bd4ef4cd24d4dfd7eeb0ed909d6c31e63bde9876442801f
Jul 02 12:39:58.125916 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:58.125812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-srq4r" event={"ID":"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc","Type":"ContainerStarted","Data":"9ff4d8a8701eddaddc3497097180a4ca7b76cabe3759da15a27c49a47c548cbb"}
Jul 02 12:39:58.125916 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:58.125878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-srq4r" event={"ID":"d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc","Type":"ContainerStarted","Data":"6cb25fccfc47dbc3559ab4e212ed45f5b65c2262a72a9309fd7eeb60736fa5dc"}
Jul 02 12:39:58.127987 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:58.127636    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb" event={"ID":"88d662f7-9de5-4483-904b-1e95c8af917d","Type":"ContainerStarted","Data":"ae3b3bd95236b9fb4bd4ef4cd24d4dfd7eeb0ed909d6c31e63bde9876442801f"}
Jul 02 12:39:58.151072 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:58.151025    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-srq4r" podStartSLOduration=66.110830714 podStartE2EDuration="1m8.151009716s" totalImagesPullingTime="2.040179002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:58.15054719 +0000 UTC m=+68.882807600" watchObservedRunningTime="2026-07-02 12:39:58.151009716 +0000 UTC m=+68.883270125"
Jul 02 12:39:59.948601 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:59.948556    2560 patch_prober.go:28] interesting pod/image-registry-597b779bc-ph59l container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 12:39:59.949140 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:39:59.948623    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-597b779bc-ph59l" podUID="7ff563c8-df8e-47f7-a1e0-07e375994964" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 12:40:02.147041 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:02.147001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dhszc" event={"ID":"a40b3102-c663-4d18-b41b-84c6ae90d57c","Type":"ContainerStarted","Data":"ef2a5cf0eb117c0c2bf3435e4d82d73d86ceaf97332569902030dde937622b2d"}
Jul 02 12:40:02.147534 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:02.147108    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:40:02.149262 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:02.149185    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb" event={"ID":"88d662f7-9de5-4483-904b-1e95c8af917d","Type":"ContainerStarted","Data":"30e77ee260e81edc9f11e7d0514d99b4e3109e71a69488ba5193db6c1a886e43"}
Jul 02 12:40:02.149262 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:02.149235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb" event={"ID":"88d662f7-9de5-4483-904b-1e95c8af917d","Type":"ContainerStarted","Data":"0f6c9de847f724050f3476fcc789fe1e3e291b0c55e1685b106597d600c0a9c0"}
Jul 02 12:40:02.150761 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:02.150739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sw5dm" event={"ID":"ba57525a-aa69-48d0-a51b-d631b1fde187","Type":"ContainerStarted","Data":"b00a7876821a44a1f6b56fbd93ff76a02ccae15dcb5ec73fd14960d977026cdc"}
Jul 02 12:40:02.164357 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:02.164312    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dhszc" podStartSLOduration=66.418353291 podStartE2EDuration="1m12.164296124s" totalImagesPullingTime="5.745942833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:02.16370854 +0000 UTC m=+72.895968950" watchObservedRunningTime="2026-07-02 12:40:02.164296124 +0000 UTC m=+72.896556536"
Jul 02 12:40:02.182515 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:02.182466    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-xxbgb" podStartSLOduration=1.635616496 podStartE2EDuration="5.182447576s" totalImagesPullingTime="3.54683108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:39:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:02.181205113 +0000 UTC m=+72.913465548" watchObservedRunningTime="2026-07-02 12:40:02.182447576 +0000 UTC m=+72.914707976"
Jul 02 12:40:02.197569 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:02.197531    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sw5dm" podStartSLOduration=66.223989688 podStartE2EDuration="1m12.197518667s" totalImagesPullingTime="5.973528979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:02.196613682 +0000 UTC m=+72.928874092" watchObservedRunningTime="2026-07-02 12:40:02.197518667 +0000 UTC m=+72.929779076"
Jul 02 12:40:04.541233 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.541199    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-54dfx"]
Jul 02 12:40:04.543655 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.543636    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.546511 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.546475    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 12:40:04.546511 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.546478    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 12:40:04.551190 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.550875    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jz7sf\""
Jul 02 12:40:04.551190 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.551164    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 12:40:04.620546 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.620515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.620641 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.620566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-sys\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.620641 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.620605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-textfile\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.620641 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.620630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-tls\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.620803 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.620658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-metrics-client-ca\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.620803 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.620713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-wtmp\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.620803 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.620746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4mmf\" (UniqueName: \"kubernetes.io/projected/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-kube-api-access-j4mmf\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.620803 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.620781    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-accelerators-collector-config\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.620959 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.620848    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-root\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722099 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-wtmp\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722242 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4mmf\" (UniqueName: \"kubernetes.io/projected/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-kube-api-access-j4mmf\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722242 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-accelerators-collector-config\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722242 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-root\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722242 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722500 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722261    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-wtmp\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722500 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722301    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-root\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722500 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-sys\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722500 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-textfile\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722500 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722421    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-tls\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722500 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722426    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-sys\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722776 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:40:04.722519    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 12:40:04.722776 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:40:04.722585    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-tls podName:cf5a102c-3cc3-4d71-b12b-4dbae6559ed9 nodeName:}" failed. No retries permitted until 2026-07-02 12:40:05.22256653 +0000 UTC m=+75.954826933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-tls") pod "node-exporter-54dfx" (UID: "cf5a102c-3cc3-4d71-b12b-4dbae6559ed9") : secret "node-exporter-tls" not found
Jul 02 12:40:04.722776 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722611    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-metrics-client-ca\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722776 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722738    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-textfile\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.722776 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.722762    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-accelerators-collector-config\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.723096 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.723072    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-metrics-client-ca\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.724711 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.724688    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:04.741264 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:04.741238    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4mmf\" (UniqueName: \"kubernetes.io/projected/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-kube-api-access-j4mmf\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:05.227053 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.227024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-tls\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:05.229878 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.229847    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf5a102c-3cc3-4d71-b12b-4dbae6559ed9-node-exporter-tls\") pod \"node-exporter-54dfx\" (UID: \"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9\") " pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:05.453825 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.453797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-54dfx"
Jul 02 12:40:05.464644 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:40:05.464617    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5a102c_3cc3_4d71_b12b_4dbae6559ed9.slice/crio-b8fc14aa380e1541bd673802405e160a921ddaa56a2573ca6a259796622dce51 WatchSource:0}: Error finding container b8fc14aa380e1541bd673802405e160a921ddaa56a2573ca6a259796622dce51: Status 404 returned error can't find the container with id b8fc14aa380e1541bd673802405e160a921ddaa56a2573ca6a259796622dce51
Jul 02 12:40:05.811375 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.811348    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-688fdc4b55-z48xj"]
Jul 02 12:40:05.814416 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.814399    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:05.818478 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.818458    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ftbjz\""
Jul 02 12:40:05.818597 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.818495    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 12:40:05.820952 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.820922    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 12:40:05.821043 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.820956    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 12:40:05.821043 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.821021    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 12:40:05.821043 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.820956    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 12:40:05.828819 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.828802    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 12:40:05.853868 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.853838    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688fdc4b55-z48xj"]
Jul 02 12:40:05.933106 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.933073    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-service-ca\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:05.933256 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.933125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-oauth-serving-cert\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:05.933256 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.933159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-oauth-config\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:05.933256 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.933212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-config\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:05.933256 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.933249    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-serving-cert\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:05.933445 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.933267    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-trusted-ca-bundle\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:05.933445 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:05.933282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxnzg\" (UniqueName: \"kubernetes.io/projected/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-kube-api-access-nxnzg\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.034522 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.034495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-serving-cert\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.034675 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.034530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-trusted-ca-bundle\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.034675 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.034555    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxnzg\" (UniqueName: \"kubernetes.io/projected/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-kube-api-access-nxnzg\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.034874 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.034847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-service-ca\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.034945 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.034907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-oauth-serving-cert\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.035000 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.034953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-oauth-config\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.035058 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.035025    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-config\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.035508 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.035474    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-trusted-ca-bundle\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.035614 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.035573    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-oauth-serving-cert\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.035687 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.035607    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-service-ca\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.035777 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.035744    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-config\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.037507 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.037487    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-serving-cert\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.037687 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.037671    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-oauth-config\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.053079 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.053057    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxnzg\" (UniqueName: \"kubernetes.io/projected/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-kube-api-access-nxnzg\") pod \"console-688fdc4b55-z48xj\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") " pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.123242 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.123181    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:06.168576 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.168542    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-54dfx" event={"ID":"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9","Type":"ContainerStarted","Data":"b8fc14aa380e1541bd673802405e160a921ddaa56a2573ca6a259796622dce51"}
Jul 02 12:40:06.289404 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:06.289324    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688fdc4b55-z48xj"]
Jul 02 12:40:06.518821 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:40:06.518742    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a1a52a_52b8_4128_9c3a_b0f6dce961fb.slice/crio-d5e9331b6bc0c95eaa0f556a046e5e097c24b1cb1b44d7eccdc39b111340341f WatchSource:0}: Error finding container d5e9331b6bc0c95eaa0f556a046e5e097c24b1cb1b44d7eccdc39b111340341f: Status 404 returned error can't find the container with id d5e9331b6bc0c95eaa0f556a046e5e097c24b1cb1b44d7eccdc39b111340341f
Jul 02 12:40:07.175439 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:07.175402    2560 generic.go:356] "Generic (PLEG): container finished" podID="cf5a102c-3cc3-4d71-b12b-4dbae6559ed9" containerID="096e4a575cd9d2c235065f0446c2b339452327f586455c08764b9eda3c3f533e" exitCode=0
Jul 02 12:40:07.175886 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:07.175502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-54dfx" event={"ID":"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9","Type":"ContainerDied","Data":"096e4a575cd9d2c235065f0446c2b339452327f586455c08764b9eda3c3f533e"}
Jul 02 12:40:07.176943 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:07.176913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688fdc4b55-z48xj" event={"ID":"91a1a52a-52b8-4128-9c3a-b0f6dce961fb","Type":"ContainerStarted","Data":"d5e9331b6bc0c95eaa0f556a046e5e097c24b1cb1b44d7eccdc39b111340341f"}
Jul 02 12:40:09.418477 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.418293    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d967bc95d-j2262"]
Jul 02 12:40:09.420531 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.420504    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.453827 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.453800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d967bc95d-j2262"]
Jul 02 12:40:09.465099 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.465077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-console-config\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.465223 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.465110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv8j4\" (UniqueName: \"kubernetes.io/projected/9465c304-1f26-446d-be8e-a9cc3266bb08-kube-api-access-jv8j4\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.465223 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.465138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-trusted-ca-bundle\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.465334 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.465253    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-oauth-config\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.465334 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.465310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-oauth-serving-cert\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.465450 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.465362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-service-ca\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.465450 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.465398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-serving-cert\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.566669 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.566630    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-trusted-ca-bundle\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.566822 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.566698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-oauth-config\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.566822 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.566736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-oauth-serving-cert\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.566822 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.566771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-service-ca\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.566822 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.566797    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-serving-cert\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.567027 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.566822    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-console-config\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.567027 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.566846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv8j4\" (UniqueName: \"kubernetes.io/projected/9465c304-1f26-446d-be8e-a9cc3266bb08-kube-api-access-jv8j4\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.567507 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.567470    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-service-ca\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.567658 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.567541    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-oauth-serving-cert\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.567658 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.567575    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-trusted-ca-bundle\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.567776 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.567754    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-console-config\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.569594 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.569561    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-serving-cert\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.569699 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.569640    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-oauth-config\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.576295 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.576274    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv8j4\" (UniqueName: \"kubernetes.io/projected/9465c304-1f26-446d-be8e-a9cc3266bb08-kube-api-access-jv8j4\") pod \"console-d967bc95d-j2262\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") " pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.730823 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.730752    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:09.945483 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:09.945450    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:40:10.922413 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:10.922377    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 12:40:11.039774 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.039342    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 12:40:11.039774 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.039531    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.044164 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.044138    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 12:40:11.044164 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.044158    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 12:40:11.044410 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.044138    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 12:40:11.044410 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.044144    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 12:40:11.044566 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.044509    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 12:40:11.044862 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.044846    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 12:40:11.045166 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.045126    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-25t93ohll87nr\""
Jul 02 12:40:11.045166 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.045159    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 12:40:11.045447 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.045415    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 12:40:11.045516 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.045481    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 12:40:11.049301 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.048958    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 12:40:11.049301 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.049162    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 12:40:11.071641 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.071618    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 12:40:11.071747 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.071661    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m4d7n\""
Jul 02 12:40:11.071940 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.071925    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 12:40:11.072238 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.072222    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 12:40:11.072661 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.072640    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 12:40:11.183042 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.182964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-config\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183042 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183042 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183321 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183096    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183321 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183144    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183321 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183196    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183321 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx6rx\" (UniqueName: \"kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-kube-api-access-gx6rx\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183321 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183562 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183562 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-web-config\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183562 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183386    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-config-out\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183562 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183562 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183562 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183562 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183562 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183562 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183895 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183895 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.183895 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.183682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.284985 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.284953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.284985 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.284983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-web-config\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285211 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-config-out\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285211 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285211 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285211 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285074    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285211 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285211 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285211 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285211 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-config\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285410    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx6rx\" (UniqueName: \"kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-kube-api-access-gx6rx\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.285654 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.285566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.286702 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.286164    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.286702 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.286391    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.286702 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.286589    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.287405 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.287381    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.288699 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.288072    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.288699 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.288306    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.289386 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.289360    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.290204 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.290176    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-config-out\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.290299 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.290239    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-config\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.291556 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.291534    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.291935 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.291721    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.292097 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.292077    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.292141 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.292107    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.292577 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.292483    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.292577 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.292530    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.292714 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.292652    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.292714 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.292661    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-web-config\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.292821 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.292761    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.296536 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.296514    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx6rx\" (UniqueName: \"kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-kube-api-access-gx6rx\") pod \"prometheus-k8s-0\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:11.353164 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:11.353134    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:12.079173 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:12.079142    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75755fbc89-7h7vm"
Jul 02 12:40:14.053497 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:14.053474    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 12:40:14.055673 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:40:14.055649    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91ac5b1_5636_4922_b4c3_3218670d48af.slice/crio-45511909ec978ae677b421b652222af45f86244f56f2ec193ff3e8be472b4955 WatchSource:0}: Error finding container 45511909ec978ae677b421b652222af45f86244f56f2ec193ff3e8be472b4955: Status 404 returned error can't find the container with id 45511909ec978ae677b421b652222af45f86244f56f2ec193ff3e8be472b4955
Jul 02 12:40:14.059478 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:14.059442    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d967bc95d-j2262"]
Jul 02 12:40:14.064726 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:40:14.064698    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9465c304_1f26_446d_be8e_a9cc3266bb08.slice/crio-513d298256f036d9671c5614c85040d13b15c135bac8f814f41604cfbe2f14ed WatchSource:0}: Error finding container 513d298256f036d9671c5614c85040d13b15c135bac8f814f41604cfbe2f14ed: Status 404 returned error can't find the container with id 513d298256f036d9671c5614c85040d13b15c135bac8f814f41604cfbe2f14ed
Jul 02 12:40:14.211076 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:14.211019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-54dfx" event={"ID":"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9","Type":"ContainerStarted","Data":"c1f689069085e26f7db2c7958025fc41f9eb26d50c402ead3ddfcdd83396a76e"}
Jul 02 12:40:14.211076 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:14.211069    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-54dfx" event={"ID":"cf5a102c-3cc3-4d71-b12b-4dbae6559ed9","Type":"ContainerStarted","Data":"e99422597ed4244b965e30168c2d2d15c590e5ef2da5a9d6c13b8f0c523b0ef7"}
Jul 02 12:40:14.212235 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:14.212210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d967bc95d-j2262" event={"ID":"9465c304-1f26-446d-be8e-a9cc3266bb08","Type":"ContainerStarted","Data":"513d298256f036d9671c5614c85040d13b15c135bac8f814f41604cfbe2f14ed"}
Jul 02 12:40:14.213234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:14.213216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerStarted","Data":"45511909ec978ae677b421b652222af45f86244f56f2ec193ff3e8be472b4955"}
Jul 02 12:40:14.232029 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:14.231986    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-54dfx" podStartSLOduration=9.080629084 podStartE2EDuration="10.231973234s" totalImagesPullingTime="1.078229303s" totalInitContainerRuntime="73.114847ms" isStatefulPod=true podCreationTimestamp="2026-07-02 12:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:14.231206901 +0000 UTC m=+84.963467329" watchObservedRunningTime="2026-07-02 12:40:14.231973234 +0000 UTC m=+84.964233643"
Jul 02 12:40:14.960555 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:14.960451    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-597b779bc-ph59l" podUID="7ff563c8-df8e-47f7-a1e0-07e375994964" containerName="registry" containerID="cri-o://795a138466a9bd898e6f51757a7bfc37d47001e6f11e8658959a6d98b0071fb4" gracePeriod=30
Jul 02 12:40:15.222571 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:15.222487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-52k77" event={"ID":"901f9009-f609-476f-ba60-0a346db71f86","Type":"ContainerStarted","Data":"4840cc0ad04904ebb73273673ba36d459eddb26c0668459c00dd34acafbb5aae"}
Jul 02 12:40:15.225067 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:15.225042    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-52k77"
Jul 02 12:40:15.227838 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:15.227813    2560 generic.go:356] "Generic (PLEG): container finished" podID="7ff563c8-df8e-47f7-a1e0-07e375994964" containerID="795a138466a9bd898e6f51757a7bfc37d47001e6f11e8658959a6d98b0071fb4" exitCode=0
Jul 02 12:40:15.227956 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:15.227929    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597b779bc-ph59l" event={"ID":"7ff563c8-df8e-47f7-a1e0-07e375994964","Type":"ContainerDied","Data":"795a138466a9bd898e6f51757a7bfc37d47001e6f11e8658959a6d98b0071fb4"}
Jul 02 12:40:15.230679 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:15.230659    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-52k77"
Jul 02 12:40:15.247132 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:15.247080    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-52k77" podStartSLOduration=4.102205006 podStartE2EDuration="23.247062251s" totalImagesPullingTime="19.144857245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:15.246517945 +0000 UTC m=+85.978778379" watchObservedRunningTime="2026-07-02 12:40:15.247062251 +0000 UTC m=+85.979322663"
Jul 02 12:40:15.935093 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:15.935017    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:40:16.029145 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.028180    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-bound-sa-token\") pod \"7ff563c8-df8e-47f7-a1e0-07e375994964\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") "
Jul 02 12:40:16.029145 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.028231    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls\") pod \"7ff563c8-df8e-47f7-a1e0-07e375994964\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") "
Jul 02 12:40:16.029145 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.028272    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-certificates\") pod \"7ff563c8-df8e-47f7-a1e0-07e375994964\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") "
Jul 02 12:40:16.029145 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.028318    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dvsb\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-kube-api-access-5dvsb\") pod \"7ff563c8-df8e-47f7-a1e0-07e375994964\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") "
Jul 02 12:40:16.029145 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.028375    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-trusted-ca\") pod \"7ff563c8-df8e-47f7-a1e0-07e375994964\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") "
Jul 02 12:40:16.029145 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.028408    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-installation-pull-secrets\") pod \"7ff563c8-df8e-47f7-a1e0-07e375994964\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") "
Jul 02 12:40:16.029145 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.028474    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ff563c8-df8e-47f7-a1e0-07e375994964-ca-trust-extracted\") pod \"7ff563c8-df8e-47f7-a1e0-07e375994964\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") "
Jul 02 12:40:16.029145 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.028547    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-image-registry-private-configuration\") pod \"7ff563c8-df8e-47f7-a1e0-07e375994964\" (UID: \"7ff563c8-df8e-47f7-a1e0-07e375994964\") "
Jul 02 12:40:16.031391 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.030856    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7ff563c8-df8e-47f7-a1e0-07e375994964" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:40:16.031391 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.031334    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7ff563c8-df8e-47f7-a1e0-07e375994964" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:40:16.031595 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.031536    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7ff563c8-df8e-47f7-a1e0-07e375994964" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:40:16.033380 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.033340    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7ff563c8-df8e-47f7-a1e0-07e375994964" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:40:16.036874 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.036824    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7ff563c8-df8e-47f7-a1e0-07e375994964" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 12:40:16.042621 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.042589    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-kube-api-access-5dvsb" (OuterVolumeSpecName: "kube-api-access-5dvsb") pod "7ff563c8-df8e-47f7-a1e0-07e375994964" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964"). InnerVolumeSpecName "kube-api-access-5dvsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 12:40:16.042949 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.042922    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff563c8-df8e-47f7-a1e0-07e375994964-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7ff563c8-df8e-47f7-a1e0-07e375994964" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 12:40:16.043553 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.043287    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7ff563c8-df8e-47f7-a1e0-07e375994964" (UID: "7ff563c8-df8e-47f7-a1e0-07e375994964"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 12:40:16.129558 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.129407    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-image-registry-private-configuration\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:16.129558 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.129461    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-bound-sa-token\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:16.129558 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.129477    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:16.129558 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.129486    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-registry-certificates\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:16.129558 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.129496    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dvsb\" (UniqueName: \"kubernetes.io/projected/7ff563c8-df8e-47f7-a1e0-07e375994964-kube-api-access-5dvsb\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:16.129558 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.129505    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ff563c8-df8e-47f7-a1e0-07e375994964-trusted-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:16.129558 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.129513    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ff563c8-df8e-47f7-a1e0-07e375994964-installation-pull-secrets\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:16.129558 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.129525    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ff563c8-df8e-47f7-a1e0-07e375994964-ca-trust-extracted\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:16.240478 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.240298    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597b779bc-ph59l"
Jul 02 12:40:16.241138 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.240967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597b779bc-ph59l" event={"ID":"7ff563c8-df8e-47f7-a1e0-07e375994964","Type":"ContainerDied","Data":"9575891c88712432072986dc1e2fec3e221e4958ac3c02ad3f8335951f2fe71e"}
Jul 02 12:40:16.241138 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.241021    2560 scope.go:117] "RemoveContainer" containerID="795a138466a9bd898e6f51757a7bfc37d47001e6f11e8658959a6d98b0071fb4"
Jul 02 12:40:16.277118 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.277092    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-597b779bc-ph59l"]
Jul 02 12:40:16.289721 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:16.289664    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-597b779bc-ph59l"]
Jul 02 12:40:17.247491 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:17.247420    2560 generic.go:356] "Generic (PLEG): container finished" podID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerID="900ee534efcf52323e6a430a3f870e3e36a864976b1383abe1c53ba05bf4c463" exitCode=0
Jul 02 12:40:17.248220 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:17.247527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerDied","Data":"900ee534efcf52323e6a430a3f870e3e36a864976b1383abe1c53ba05bf4c463"}
Jul 02 12:40:17.707061 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:17.707024    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ff563c8-df8e-47f7-a1e0-07e375994964" path="/var/lib/kubelet/pods/7ff563c8-df8e-47f7-a1e0-07e375994964/volumes"
Jul 02 12:40:19.261271 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:19.261090    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688fdc4b55-z48xj" event={"ID":"91a1a52a-52b8-4128-9c3a-b0f6dce961fb","Type":"ContainerStarted","Data":"d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc"}
Jul 02 12:40:19.263551 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:19.263520    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d967bc95d-j2262" event={"ID":"9465c304-1f26-446d-be8e-a9cc3266bb08","Type":"ContainerStarted","Data":"2f0bfbd7b90ed21723941fc0c72e4854f057df3d258d0f7e88e1c0cb7daa2d61"}
Jul 02 12:40:19.294638 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:19.294541    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-688fdc4b55-z48xj" podStartSLOduration=2.087437149 podStartE2EDuration="14.294523081s" totalImagesPullingTime="12.207085932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:19.293623033 +0000 UTC m=+90.025883468" watchObservedRunningTime="2026-07-02 12:40:19.294523081 +0000 UTC m=+90.026783491"
Jul 02 12:40:19.322481 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:19.321325    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d967bc95d-j2262" podStartSLOduration=5.651573652 podStartE2EDuration="10.321305794s" totalImagesPullingTime="4.669732142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:19.31981337 +0000 UTC m=+90.052073801" watchObservedRunningTime="2026-07-02 12:40:19.321305794 +0000 UTC m=+90.053566203"
Jul 02 12:40:19.730867 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:19.730836    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:19.731218 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:19.731195    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:19.737773 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:19.737741    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:20.273723 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:20.273697    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:40:20.340758 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:20.340731    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688fdc4b55-z48xj"]
Jul 02 12:40:23.286067 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:23.286028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerStarted","Data":"284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824"}
Jul 02 12:40:23.286528 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:23.286118    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerStarted","Data":"a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7"}
Jul 02 12:40:25.298476 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:25.298449    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerStarted","Data":"45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48"}
Jul 02 12:40:25.298845 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:25.298535    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerStarted","Data":"71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5"}
Jul 02 12:40:25.298845 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:25.298562    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerStarted","Data":"986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5"}
Jul 02 12:40:26.123284 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:26.123254    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:26.305668 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:26.305642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerStarted","Data":"f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01"}
Jul 02 12:40:26.340560 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:26.340512    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.590473548 podStartE2EDuration="16.340494516s" totalImagesPullingTime="9.719396365s" totalInitContainerRuntime="30.624603ms" isStatefulPod=false podCreationTimestamp="2026-07-02 12:40:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:26.338187319 +0000 UTC m=+97.070447739" watchObservedRunningTime="2026-07-02 12:40:26.340494516 +0000 UTC m=+97.072754924"
Jul 02 12:40:26.353602 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:26.353577    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:40:33.156310 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:33.156284    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dhszc"
Jul 02 12:40:46.300598 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.300559    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-688fdc4b55-z48xj" podUID="91a1a52a-52b8-4128-9c3a-b0f6dce961fb" containerName="console" containerID="cri-o://d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc" gracePeriod=15
Jul 02 12:40:46.572834 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.572784    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:46.650822 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.650802    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-trusted-ca-bundle\") pod \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") "
Jul 02 12:40:46.650929 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.650832    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-oauth-config\") pod \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") "
Jul 02 12:40:46.650929 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.650849    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-config\") pod \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") "
Jul 02 12:40:46.650929 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.650870    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-serving-cert\") pod \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") "
Jul 02 12:40:46.650929 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.650895    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxnzg\" (UniqueName: \"kubernetes.io/projected/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-kube-api-access-nxnzg\") pod \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") "
Jul 02 12:40:46.651103 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.650937    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-oauth-serving-cert\") pod \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") "
Jul 02 12:40:46.651103 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.650992    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-service-ca\") pod \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\" (UID: \"91a1a52a-52b8-4128-9c3a-b0f6dce961fb\") "
Jul 02 12:40:46.651305 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.651225    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-config" (OuterVolumeSpecName: "console-config") pod "91a1a52a-52b8-4128-9c3a-b0f6dce961fb" (UID: "91a1a52a-52b8-4128-9c3a-b0f6dce961fb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:40:46.651448 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.651237    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "91a1a52a-52b8-4128-9c3a-b0f6dce961fb" (UID: "91a1a52a-52b8-4128-9c3a-b0f6dce961fb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:40:46.651515 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.651472    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91a1a52a-52b8-4128-9c3a-b0f6dce961fb" (UID: "91a1a52a-52b8-4128-9c3a-b0f6dce961fb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:40:46.651581 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.651507    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-service-ca" (OuterVolumeSpecName: "service-ca") pod "91a1a52a-52b8-4128-9c3a-b0f6dce961fb" (UID: "91a1a52a-52b8-4128-9c3a-b0f6dce961fb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:40:46.653074 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.653048    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91a1a52a-52b8-4128-9c3a-b0f6dce961fb" (UID: "91a1a52a-52b8-4128-9c3a-b0f6dce961fb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:40:46.653172 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.653095    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-kube-api-access-nxnzg" (OuterVolumeSpecName: "kube-api-access-nxnzg") pod "91a1a52a-52b8-4128-9c3a-b0f6dce961fb" (UID: "91a1a52a-52b8-4128-9c3a-b0f6dce961fb"). InnerVolumeSpecName "kube-api-access-nxnzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 12:40:46.653225 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.653168    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91a1a52a-52b8-4128-9c3a-b0f6dce961fb" (UID: "91a1a52a-52b8-4128-9c3a-b0f6dce961fb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:40:46.751767 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.751748    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-trusted-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:46.751864 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.751770    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-oauth-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:46.751864 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.751784    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:46.751864 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.751796    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-console-serving-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:46.751864 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.751809    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxnzg\" (UniqueName: \"kubernetes.io/projected/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-kube-api-access-nxnzg\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:46.751864 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.751823    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-oauth-serving-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:46.751864 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:46.751836    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91a1a52a-52b8-4128-9c3a-b0f6dce961fb-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:40:47.385676 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:47.385635    2560 generic.go:356] "Generic (PLEG): container finished" podID="91a1a52a-52b8-4128-9c3a-b0f6dce961fb" containerID="d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc" exitCode=0
Jul 02 12:40:47.386068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:47.385708    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688fdc4b55-z48xj"
Jul 02 12:40:47.386068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:47.385720    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688fdc4b55-z48xj" event={"ID":"91a1a52a-52b8-4128-9c3a-b0f6dce961fb","Type":"ContainerDied","Data":"d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc"}
Jul 02 12:40:47.386068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:47.385796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688fdc4b55-z48xj" event={"ID":"91a1a52a-52b8-4128-9c3a-b0f6dce961fb","Type":"ContainerDied","Data":"d5e9331b6bc0c95eaa0f556a046e5e097c24b1cb1b44d7eccdc39b111340341f"}
Jul 02 12:40:47.386068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:47.385816    2560 scope.go:117] "RemoveContainer" containerID="d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc"
Jul 02 12:40:47.394520 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:47.394503    2560 scope.go:117] "RemoveContainer" containerID="d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc"
Jul 02 12:40:47.394779 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:40:47.394759    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc\": container with ID starting with d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc not found: ID does not exist" containerID="d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc"
Jul 02 12:40:47.394845 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:47.394787    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc"} err="failed to get container status \"d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc\": rpc error: code = NotFound desc = could not find container \"d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc\": container with ID starting with d2513ab450456586a994cc960ad120889df70fd669bd6a54c7900ecb501d66dc not found: ID does not exist"
Jul 02 12:40:47.407531 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:47.407511    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688fdc4b55-z48xj"]
Jul 02 12:40:47.411208 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:47.411191    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-688fdc4b55-z48xj"]
Jul 02 12:40:47.705174 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:40:47.705101    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91a1a52a-52b8-4128-9c3a-b0f6dce961fb" path="/var/lib/kubelet/pods/91a1a52a-52b8-4128-9c3a-b0f6dce961fb/volumes"
Jul 02 12:41:11.353694 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:11.353659    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:11.374198 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:11.374175    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:11.485122 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:11.485095    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:29.282448 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.282404    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 12:41:29.282983 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.282712    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy" containerID="cri-o://45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48" gracePeriod=600
Jul 02 12:41:29.282983 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.282707    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="prometheus" containerID="cri-o://a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7" gracePeriod=600
Jul 02 12:41:29.282983 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.282776    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy-web" containerID="cri-o://71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5" gracePeriod=600
Jul 02 12:41:29.282983 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.282783    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01" gracePeriod=600
Jul 02 12:41:29.282983 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.282782    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="config-reloader" containerID="cri-o://284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824" gracePeriod=600
Jul 02 12:41:29.282983 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.282782    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="thanos-sidecar" containerID="cri-o://986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5" gracePeriod=600
Jul 02 12:41:29.537352 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.537279    2560 generic.go:356] "Generic (PLEG): container finished" podID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerID="f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01" exitCode=0
Jul 02 12:41:29.537352 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.537302    2560 generic.go:356] "Generic (PLEG): container finished" podID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerID="45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48" exitCode=0
Jul 02 12:41:29.537352 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.537309    2560 generic.go:356] "Generic (PLEG): container finished" podID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerID="986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5" exitCode=0
Jul 02 12:41:29.537352 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.537314    2560 generic.go:356] "Generic (PLEG): container finished" podID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerID="284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824" exitCode=0
Jul 02 12:41:29.537352 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.537319    2560 generic.go:356] "Generic (PLEG): container finished" podID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerID="a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7" exitCode=0
Jul 02 12:41:29.537621 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.537360    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerDied","Data":"f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01"}
Jul 02 12:41:29.537621 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.537422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerDied","Data":"45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48"}
Jul 02 12:41:29.537621 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.537471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerDied","Data":"986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5"}
Jul 02 12:41:29.537621 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.537497    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerDied","Data":"284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824"}
Jul 02 12:41:29.537621 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:29.537522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerDied","Data":"a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7"}
Jul 02 12:41:30.527131 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.527110    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:30.544671 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.544643    2560 generic.go:356] "Generic (PLEG): container finished" podID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerID="71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5" exitCode=0
Jul 02 12:41:30.544762 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.544708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerDied","Data":"71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5"}
Jul 02 12:41:30.544762 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.544718    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:30.544834 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.544809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f91ac5b1-5636-4922-b4c3-3218670d48af","Type":"ContainerDied","Data":"45511909ec978ae677b421b652222af45f86244f56f2ec193ff3e8be472b4955"}
Jul 02 12:41:30.544870 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.544859    2560 scope.go:117] "RemoveContainer" containerID="f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01"
Jul 02 12:41:30.551667 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.551646    2560 scope.go:117] "RemoveContainer" containerID="45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48"
Jul 02 12:41:30.558147 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.558131    2560 scope.go:117] "RemoveContainer" containerID="71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5"
Jul 02 12:41:30.564395 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.564377    2560 scope.go:117] "RemoveContainer" containerID="986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5"
Jul 02 12:41:30.571877 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.571859    2560 scope.go:117] "RemoveContainer" containerID="284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824"
Jul 02 12:41:30.580143 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.580125    2560 scope.go:117] "RemoveContainer" containerID="a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7"
Jul 02 12:41:30.587355 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.587335    2560 scope.go:117] "RemoveContainer" containerID="900ee534efcf52323e6a430a3f870e3e36a864976b1383abe1c53ba05bf4c463"
Jul 02 12:41:30.594930 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.594913    2560 scope.go:117] "RemoveContainer" containerID="f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01"
Jul 02 12:41:30.595181 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:41:30.595161    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01\": container with ID starting with f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01 not found: ID does not exist" containerID="f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01"
Jul 02 12:41:30.595236 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.595191    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01"} err="failed to get container status \"f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01\": rpc error: code = NotFound desc = could not find container \"f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01\": container with ID starting with f3e67989472be9b296ac173a8126d72b7f623b09d13c289867579874ba98da01 not found: ID does not exist"
Jul 02 12:41:30.595236 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.595208    2560 scope.go:117] "RemoveContainer" containerID="45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48"
Jul 02 12:41:30.595489 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:41:30.595475    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48\": container with ID starting with 45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48 not found: ID does not exist" containerID="45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48"
Jul 02 12:41:30.595557 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.595492    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48"} err="failed to get container status \"45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48\": rpc error: code = NotFound desc = could not find container \"45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48\": container with ID starting with 45309dd664b40a381abdd7cacca9a91aa861375eef457f7044bd7854dbcf4a48 not found: ID does not exist"
Jul 02 12:41:30.595557 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.595508    2560 scope.go:117] "RemoveContainer" containerID="71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5"
Jul 02 12:41:30.595743 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:41:30.595730    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5\": container with ID starting with 71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5 not found: ID does not exist" containerID="71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5"
Jul 02 12:41:30.595793 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.595745    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5"} err="failed to get container status \"71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5\": rpc error: code = NotFound desc = could not find container \"71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5\": container with ID starting with 71e941eb61695f0ac59c3267f91569b768aee782c5bfa1df607f71f7f26a4cf5 not found: ID does not exist"
Jul 02 12:41:30.595793 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.595756    2560 scope.go:117] "RemoveContainer" containerID="986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5"
Jul 02 12:41:30.595972 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:41:30.595955    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5\": container with ID starting with 986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5 not found: ID does not exist" containerID="986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5"
Jul 02 12:41:30.596032 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.595982    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5"} err="failed to get container status \"986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5\": rpc error: code = NotFound desc = could not find container \"986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5\": container with ID starting with 986abe30759efe041a7ab0ba4dedb6cee05c9498f9598b0fc4d8bb100f46a1c5 not found: ID does not exist"
Jul 02 12:41:30.596032 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.596003    2560 scope.go:117] "RemoveContainer" containerID="284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824"
Jul 02 12:41:30.596272 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:41:30.596251    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824\": container with ID starting with 284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824 not found: ID does not exist" containerID="284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824"
Jul 02 12:41:30.596319 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.596280    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824"} err="failed to get container status \"284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824\": rpc error: code = NotFound desc = could not find container \"284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824\": container with ID starting with 284b6d550c5710ed19f78a9eb898123eee922f9d999619a2b4916268acb2b824 not found: ID does not exist"
Jul 02 12:41:30.596319 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.596299    2560 scope.go:117] "RemoveContainer" containerID="a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7"
Jul 02 12:41:30.596546 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:41:30.596528    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7\": container with ID starting with a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7 not found: ID does not exist" containerID="a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7"
Jul 02 12:41:30.596614 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.596553    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7"} err="failed to get container status \"a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7\": rpc error: code = NotFound desc = could not find container \"a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7\": container with ID starting with a1e057d0e19fe50cdfda9929e4bc86c3695600c7f8bbef67941fabd1b97b17e7 not found: ID does not exist"
Jul 02 12:41:30.596614 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.596575    2560 scope.go:117] "RemoveContainer" containerID="900ee534efcf52323e6a430a3f870e3e36a864976b1383abe1c53ba05bf4c463"
Jul 02 12:41:30.596816 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:41:30.596799    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"900ee534efcf52323e6a430a3f870e3e36a864976b1383abe1c53ba05bf4c463\": container with ID starting with 900ee534efcf52323e6a430a3f870e3e36a864976b1383abe1c53ba05bf4c463 not found: ID does not exist" containerID="900ee534efcf52323e6a430a3f870e3e36a864976b1383abe1c53ba05bf4c463"
Jul 02 12:41:30.596863 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.596819    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"900ee534efcf52323e6a430a3f870e3e36a864976b1383abe1c53ba05bf4c463"} err="failed to get container status \"900ee534efcf52323e6a430a3f870e3e36a864976b1383abe1c53ba05bf4c463\": rpc error: code = NotFound desc = could not find container \"900ee534efcf52323e6a430a3f870e3e36a864976b1383abe1c53ba05bf4c463\": container with ID starting with 900ee534efcf52323e6a430a3f870e3e36a864976b1383abe1c53ba05bf4c463 not found: ID does not exist"
Jul 02 12:41:30.674972 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.674924    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-tls-assets\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.674972 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.674953    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-tls\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675121 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.674974    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-kube-rbac-proxy\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675121 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675002    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-2\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675121 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675018    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-metrics-client-certs\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675121 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675041    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-kubelet-serving-ca-bundle\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675121 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675074    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-thanos-prometheus-http-client-file\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675121 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675107    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-config\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675142    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675184    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-config-out\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675208    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-serving-certs-ca-bundle\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675234    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-trusted-ca-bundle\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675266    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-1\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675290    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-0\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675317    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-web-config\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675352    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-metrics-client-ca\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675378    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675384    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:41:30.675411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675403    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-grpc-tls\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675975 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675427    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx6rx\" (UniqueName: \"kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-kube-api-access-gx6rx\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675975 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675482    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:41:30.675975 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675499    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-db\") pod \"f91ac5b1-5636-4922-b4c3-3218670d48af\" (UID: \"f91ac5b1-5636-4922-b4c3-3218670d48af\") "
Jul 02 12:41:30.675975 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675698    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:41:30.675975 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675809    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.675975 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675828    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.675975 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.675845    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.677005 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.676976    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:41:30.677005 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.676988    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:41:30.677452 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.677410    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:41:30.677545 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.677514    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 12:41:30.678280 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.678254    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:41:30.678465 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.678420    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:41:30.678895 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.678871    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:41:30.678895 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.678875    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 12:41:30.679068 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.678786    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:41:30.679128 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.679113    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:41:30.679247 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.679226    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:41:30.679878 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.679852    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:41:30.679981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.679893    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-config-out" (OuterVolumeSpecName: "config-out") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 12:41:30.680130 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.680114    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-kube-api-access-gx6rx" (OuterVolumeSpecName: "kube-api-access-gx6rx") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "kube-api-access-gx6rx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 12:41:30.680883 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.680863    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:41:30.680968 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.680883    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-config" (OuterVolumeSpecName: "config") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:41:30.689888 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.689865    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-web-config" (OuterVolumeSpecName: "web-config") pod "f91ac5b1-5636-4922-b4c3-3218670d48af" (UID: "f91ac5b1-5636-4922-b4c3-3218670d48af"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:41:30.776466 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776425    2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776540 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776470    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776540 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776483    2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-config-out\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776540 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776497    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776540 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776510    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776540 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776523    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776540 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776537    2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-web-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776717 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776550    2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91ac5b1-5636-4922-b4c3-3218670d48af-configmap-metrics-client-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776717 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776566    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776717 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776580    2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-grpc-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776717 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776595    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx6rx\" (UniqueName: \"kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-kube-api-access-gx6rx\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776717 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776609    2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f91ac5b1-5636-4922-b4c3-3218670d48af-prometheus-k8s-db\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776717 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776622    2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f91ac5b1-5636-4922-b4c3-3218670d48af-tls-assets\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776717 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776633    2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776717 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776644    2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-kube-rbac-proxy\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776717 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776652    2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-secret-metrics-client-certs\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.776717 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.776660    2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f91ac5b1-5636-4922-b4c3-3218670d48af-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:41:30.874470 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.874449    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 12:41:30.885311 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.885288    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 12:41:30.925318 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925258    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 12:41:30.925508 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925495    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a1a52a-52b8-4128-9c3a-b0f6dce961fb" containerName="console"
Jul 02 12:41:30.925551 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925509    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a1a52a-52b8-4128-9c3a-b0f6dce961fb" containerName="console"
Jul 02 12:41:30.925551 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925519    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff563c8-df8e-47f7-a1e0-07e375994964" containerName="registry"
Jul 02 12:41:30.925551 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925525    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff563c8-df8e-47f7-a1e0-07e375994964" containerName="registry"
Jul 02 12:41:30.925551 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925537    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy-web"
Jul 02 12:41:30.925551 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925543    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy-web"
Jul 02 12:41:30.925551 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925550    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy-thanos"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925555    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy-thanos"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925562    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925567    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925576    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="config-reloader"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925581    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="config-reloader"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925587    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="init-config-reloader"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925592    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="init-config-reloader"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925598    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="prometheus"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925603    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="prometheus"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925608    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="thanos-sidecar"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925613    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="thanos-sidecar"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925649    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="config-reloader"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925657    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff563c8-df8e-47f7-a1e0-07e375994964" containerName="registry"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925662    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="thanos-sidecar"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925669    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="prometheus"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925674    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy-thanos"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925679    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925684    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a1a52a-52b8-4128-9c3a-b0f6dce961fb" containerName="console"
Jul 02 12:41:30.925728 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.925689    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" containerName="kube-rbac-proxy-web"
Jul 02 12:41:30.929451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.929412    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:30.935327 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.935306    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 12:41:30.935694 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.935640    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 12:41:30.935881 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.935868    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 12:41:30.936061 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.936045    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m4d7n\""
Jul 02 12:41:30.936061 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.936056    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 12:41:30.936252 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.936235    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 12:41:30.936309 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.936239    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 12:41:30.936363 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.936312    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 12:41:30.936363 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.936328    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-25t93ohll87nr\""
Jul 02 12:41:30.936516 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.936411    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 12:41:30.936628 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.936614    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 12:41:30.937077 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.937009    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 12:41:30.937302 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.937282    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 12:41:30.937390 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.937287    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 12:41:30.937578 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.937563    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 12:41:30.938883 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.938862    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 12:41:30.943861 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.943845    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 12:41:30.963188 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:30.963163    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 12:41:31.079124 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079221 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fafb552-296a-4a29-98c0-a7fef6253b3e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079221 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079295 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079295 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079295 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-config\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079295 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079293    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079407 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079407 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079407 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079407 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079407 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079580 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079580 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079580 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9s4b\" (UniqueName: \"kubernetes.io/projected/5fafb552-296a-4a29-98c0-a7fef6253b3e-kube-api-access-r9s4b\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079580 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fafb552-296a-4a29-98c0-a7fef6253b3e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079580 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079580 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079580 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.079580 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.079576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180473 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180473 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180449    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180473 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180610 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180610 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180683 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180609    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180683 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180683 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180825 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180694    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9s4b\" (UniqueName: \"kubernetes.io/projected/5fafb552-296a-4a29-98c0-a7fef6253b3e-kube-api-access-r9s4b\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180825 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fafb552-296a-4a29-98c0-a7fef6253b3e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180825 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180825 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.180825 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.181060 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.181060 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.181060 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fafb552-296a-4a29-98c0-a7fef6253b3e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.181060 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.180950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.181060 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.181001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.181060 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.181033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.181060 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.181038    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.181060 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.181055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-config\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.181460 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.181038    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.182262 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.181739    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.182262 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.182003    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.184512 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.183475    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.184512 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.183576    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.184512 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.183686    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.184512 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.183817    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.184512 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.183849    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.184512 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.184111    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.184512 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.184278    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.184512 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.184304    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fafb552-296a-4a29-98c0-a7fef6253b3e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.184512 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.184472    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.184858 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.184600    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.184858 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.184722    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5fafb552-296a-4a29-98c0-a7fef6253b3e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.185568 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.185548    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fafb552-296a-4a29-98c0-a7fef6253b3e-config-out\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.186172 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.186154    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-web-config\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.186289 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.186274    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-config\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.186335 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.186320    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5fafb552-296a-4a29-98c0-a7fef6253b3e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.189496 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.189478    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9s4b\" (UniqueName: \"kubernetes.io/projected/5fafb552-296a-4a29-98c0-a7fef6253b3e-kube-api-access-r9s4b\") pod \"prometheus-k8s-0\" (UID: \"5fafb552-296a-4a29-98c0-a7fef6253b3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.240544 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.240522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:31.367092 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.367066    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 12:41:31.368927 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:41:31.368899    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fafb552_296a_4a29_98c0_a7fef6253b3e.slice/crio-697f7205201208986da7f84866c6aee3e1413125b5422191d9b3d6a17b5f2e41 WatchSource:0}: Error finding container 697f7205201208986da7f84866c6aee3e1413125b5422191d9b3d6a17b5f2e41: Status 404 returned error can't find the container with id 697f7205201208986da7f84866c6aee3e1413125b5422191d9b3d6a17b5f2e41
Jul 02 12:41:31.549520 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.549494    2560 generic.go:356] "Generic (PLEG): container finished" podID="5fafb552-296a-4a29-98c0-a7fef6253b3e" containerID="495a1d31a873347bc48edfebe8d3c91da8f6fa0d7240920afc0650bd432b2cc0" exitCode=0
Jul 02 12:41:31.549860 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.549579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fafb552-296a-4a29-98c0-a7fef6253b3e","Type":"ContainerDied","Data":"495a1d31a873347bc48edfebe8d3c91da8f6fa0d7240920afc0650bd432b2cc0"}
Jul 02 12:41:31.549860 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.549650    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fafb552-296a-4a29-98c0-a7fef6253b3e","Type":"ContainerStarted","Data":"697f7205201208986da7f84866c6aee3e1413125b5422191d9b3d6a17b5f2e41"}
Jul 02 12:41:31.705583 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:31.705556    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f91ac5b1-5636-4922-b4c3-3218670d48af" path="/var/lib/kubelet/pods/f91ac5b1-5636-4922-b4c3-3218670d48af/volumes"
Jul 02 12:41:32.557443 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:32.557411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fafb552-296a-4a29-98c0-a7fef6253b3e","Type":"ContainerStarted","Data":"81cff4135c814daf3c9fb3745fe23ed05dd280318e5b5eb61c387f130eaf0e99"}
Jul 02 12:41:32.557752 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:32.557488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fafb552-296a-4a29-98c0-a7fef6253b3e","Type":"ContainerStarted","Data":"6bbb015055856bf1fbb4689437c6bf899c70fc4561a9056b6618841cbe9ad678"}
Jul 02 12:41:32.557752 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:32.557539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fafb552-296a-4a29-98c0-a7fef6253b3e","Type":"ContainerStarted","Data":"6ad6260d8ca8895de80b1613139aabb440d21d135e4a2f1411ddec320d4699a2"}
Jul 02 12:41:32.557752 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:32.557565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fafb552-296a-4a29-98c0-a7fef6253b3e","Type":"ContainerStarted","Data":"64beb40eda0e89f6a7253ae2a96d93564a84990cdcca9fe0a98b2965c63cdcef"}
Jul 02 12:41:32.557752 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:32.557588    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fafb552-296a-4a29-98c0-a7fef6253b3e","Type":"ContainerStarted","Data":"fe0346f9a5972d69f3defca426e2aee2c7c3b40f16fe1eef0df289afdcd06f0a"}
Jul 02 12:41:32.557752 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:32.557619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5fafb552-296a-4a29-98c0-a7fef6253b3e","Type":"ContainerStarted","Data":"2659c8cf420b87e7fb30505237a5ddbe45326b669a5d92c767bda303f2aa825c"}
Jul 02 12:41:32.590743 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:32.590700    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.575163431 podStartE2EDuration="2.590686642s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.523211ms" isStatefulPod=false podCreationTimestamp="2026-07-02 12:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:41:32.588653304 +0000 UTC m=+163.320913773" watchObservedRunningTime="2026-07-02 12:41:32.590686642 +0000 UTC m=+163.322947050"
Jul 02 12:41:36.241639 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:36.241602    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:41:44.554007 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:41:44.553928    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d967bc95d-j2262"]
Jul 02 12:42:09.573168 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.573108    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d967bc95d-j2262" podUID="9465c304-1f26-446d-be8e-a9cc3266bb08" containerName="console" containerID="cri-o://2f0bfbd7b90ed21723941fc0c72e4854f057df3d258d0f7e88e1c0cb7daa2d61" gracePeriod=15
Jul 02 12:42:09.690263 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.690236    2560 generic.go:356] "Generic (PLEG): container finished" podID="9465c304-1f26-446d-be8e-a9cc3266bb08" containerID="2f0bfbd7b90ed21723941fc0c72e4854f057df3d258d0f7e88e1c0cb7daa2d61" exitCode=0
Jul 02 12:42:09.690368 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.690314    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d967bc95d-j2262" event={"ID":"9465c304-1f26-446d-be8e-a9cc3266bb08","Type":"ContainerDied","Data":"2f0bfbd7b90ed21723941fc0c72e4854f057df3d258d0f7e88e1c0cb7daa2d61"}
Jul 02 12:42:09.809121 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.809093    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:42:09.850468 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.850427    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv8j4\" (UniqueName: \"kubernetes.io/projected/9465c304-1f26-446d-be8e-a9cc3266bb08-kube-api-access-jv8j4\") pod \"9465c304-1f26-446d-be8e-a9cc3266bb08\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") "
Jul 02 12:42:09.850587 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.850478    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-console-config\") pod \"9465c304-1f26-446d-be8e-a9cc3266bb08\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") "
Jul 02 12:42:09.850587 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.850500    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-service-ca\") pod \"9465c304-1f26-446d-be8e-a9cc3266bb08\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") "
Jul 02 12:42:09.850587 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.850517    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-trusted-ca-bundle\") pod \"9465c304-1f26-446d-be8e-a9cc3266bb08\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") "
Jul 02 12:42:09.850587 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.850562    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-oauth-serving-cert\") pod \"9465c304-1f26-446d-be8e-a9cc3266bb08\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") "
Jul 02 12:42:09.850763 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.850729    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-serving-cert\") pod \"9465c304-1f26-446d-be8e-a9cc3266bb08\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") "
Jul 02 12:42:09.850844 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.850782    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-oauth-config\") pod \"9465c304-1f26-446d-be8e-a9cc3266bb08\" (UID: \"9465c304-1f26-446d-be8e-a9cc3266bb08\") "
Jul 02 12:42:09.850968 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.850942    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-service-ca" (OuterVolumeSpecName: "service-ca") pod "9465c304-1f26-446d-be8e-a9cc3266bb08" (UID: "9465c304-1f26-446d-be8e-a9cc3266bb08"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:42:09.850968 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.850956    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9465c304-1f26-446d-be8e-a9cc3266bb08" (UID: "9465c304-1f26-446d-be8e-a9cc3266bb08"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:42:09.850968 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.850951    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-console-config" (OuterVolumeSpecName: "console-config") pod "9465c304-1f26-446d-be8e-a9cc3266bb08" (UID: "9465c304-1f26-446d-be8e-a9cc3266bb08"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:42:09.850968 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.850967    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9465c304-1f26-446d-be8e-a9cc3266bb08" (UID: "9465c304-1f26-446d-be8e-a9cc3266bb08"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:42:09.851151 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.851084    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-console-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:42:09.851151 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.851102    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-service-ca\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:42:09.851151 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.851116    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-trusted-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:42:09.851151 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.851129    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9465c304-1f26-446d-be8e-a9cc3266bb08-oauth-serving-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:42:09.852540 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.852507    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9465c304-1f26-446d-be8e-a9cc3266bb08-kube-api-access-jv8j4" (OuterVolumeSpecName: "kube-api-access-jv8j4") pod "9465c304-1f26-446d-be8e-a9cc3266bb08" (UID: "9465c304-1f26-446d-be8e-a9cc3266bb08"). InnerVolumeSpecName "kube-api-access-jv8j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 12:42:09.852644 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.852614    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9465c304-1f26-446d-be8e-a9cc3266bb08" (UID: "9465c304-1f26-446d-be8e-a9cc3266bb08"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:42:09.852690 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.852674    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9465c304-1f26-446d-be8e-a9cc3266bb08" (UID: "9465c304-1f26-446d-be8e-a9cc3266bb08"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:42:09.952146 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.952122    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv8j4\" (UniqueName: \"kubernetes.io/projected/9465c304-1f26-446d-be8e-a9cc3266bb08-kube-api-access-jv8j4\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:42:09.952146 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.952141    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-serving-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:42:09.952265 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:09.952151    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9465c304-1f26-446d-be8e-a9cc3266bb08-console-oauth-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:42:10.695046 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:10.695013    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d967bc95d-j2262" event={"ID":"9465c304-1f26-446d-be8e-a9cc3266bb08","Type":"ContainerDied","Data":"513d298256f036d9671c5614c85040d13b15c135bac8f814f41604cfbe2f14ed"}
Jul 02 12:42:10.695046 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:10.695039    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d967bc95d-j2262"
Jul 02 12:42:10.695536 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:10.695067    2560 scope.go:117] "RemoveContainer" containerID="2f0bfbd7b90ed21723941fc0c72e4854f057df3d258d0f7e88e1c0cb7daa2d61"
Jul 02 12:42:10.719587 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:10.719562    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d967bc95d-j2262"]
Jul 02 12:42:10.726315 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:10.726296    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d967bc95d-j2262"]
Jul 02 12:42:11.705305 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:11.705275    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9465c304-1f26-446d-be8e-a9cc3266bb08" path="/var/lib/kubelet/pods/9465c304-1f26-446d-be8e-a9cc3266bb08/volumes"
Jul 02 12:42:31.241000 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:31.240967    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:42:31.255717 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:31.255696    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:42:31.780809 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:42:31.780784    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 12:43:49.654376 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:43:49.654349    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 12:43:49.657695 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:43:49.657677    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 12:43:49.659087 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:43:49.659069    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 12:48:44.013724 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.013694    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-mm69k"]
Jul 02 12:48:44.014119 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.013946    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9465c304-1f26-446d-be8e-a9cc3266bb08" containerName="console"
Jul 02 12:48:44.014119 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.013957    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9465c304-1f26-446d-be8e-a9cc3266bb08" containerName="console"
Jul 02 12:48:44.014119 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.014010    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9465c304-1f26-446d-be8e-a9cc3266bb08" containerName="console"
Jul 02 12:48:44.015818 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.015804    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mm69k"
Jul 02 12:48:44.018689 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.018667    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 02 12:48:44.018800 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.018697    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 02 12:48:44.019737 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.019720    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-hx67w\""
Jul 02 12:48:44.019851 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.019721    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 02 12:48:44.024877 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.024858    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-mm69k"]
Jul 02 12:48:44.094366 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.094341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9a255d4-963e-4778-a4d2-589b36c4ec59-model-cache\") pod \"s3-init-mm69k\" (UID: \"b9a255d4-963e-4778-a4d2-589b36c4ec59\") " pod="kserve/s3-init-mm69k"
Jul 02 12:48:44.094488 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.094388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-667wx\" (UniqueName: \"kubernetes.io/projected/b9a255d4-963e-4778-a4d2-589b36c4ec59-kube-api-access-667wx\") pod \"s3-init-mm69k\" (UID: \"b9a255d4-963e-4778-a4d2-589b36c4ec59\") " pod="kserve/s3-init-mm69k"
Jul 02 12:48:44.195175 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.195150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9a255d4-963e-4778-a4d2-589b36c4ec59-model-cache\") pod \"s3-init-mm69k\" (UID: \"b9a255d4-963e-4778-a4d2-589b36c4ec59\") " pod="kserve/s3-init-mm69k"
Jul 02 12:48:44.195308 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.195210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-667wx\" (UniqueName: \"kubernetes.io/projected/b9a255d4-963e-4778-a4d2-589b36c4ec59-kube-api-access-667wx\") pod \"s3-init-mm69k\" (UID: \"b9a255d4-963e-4778-a4d2-589b36c4ec59\") " pod="kserve/s3-init-mm69k"
Jul 02 12:48:44.195504 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.195485    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9a255d4-963e-4778-a4d2-589b36c4ec59-model-cache\") pod \"s3-init-mm69k\" (UID: \"b9a255d4-963e-4778-a4d2-589b36c4ec59\") " pod="kserve/s3-init-mm69k"
Jul 02 12:48:44.203556 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.203536    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-667wx\" (UniqueName: \"kubernetes.io/projected/b9a255d4-963e-4778-a4d2-589b36c4ec59-kube-api-access-667wx\") pod \"s3-init-mm69k\" (UID: \"b9a255d4-963e-4778-a4d2-589b36c4ec59\") " pod="kserve/s3-init-mm69k"
Jul 02 12:48:44.332715 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.332696    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mm69k"
Jul 02 12:48:44.451851 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.451829    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-mm69k"]
Jul 02 12:48:44.454468 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:48:44.454440    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9a255d4_963e_4778_a4d2_589b36c4ec59.slice/crio-a169085ad56cedcf7d74b1fc2a34c39fcbed4892e202849a91e6e3b7490e07c5 WatchSource:0}: Error finding container a169085ad56cedcf7d74b1fc2a34c39fcbed4892e202849a91e6e3b7490e07c5: Status 404 returned error can't find the container with id a169085ad56cedcf7d74b1fc2a34c39fcbed4892e202849a91e6e3b7490e07c5
Jul 02 12:48:44.456712 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.456696    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 12:48:44.997830 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:44.997784    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mm69k" event={"ID":"b9a255d4-963e-4778-a4d2-589b36c4ec59","Type":"ContainerStarted","Data":"a169085ad56cedcf7d74b1fc2a34c39fcbed4892e202849a91e6e3b7490e07c5"}
Jul 02 12:48:48.011707 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:48.011678    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mm69k" event={"ID":"b9a255d4-963e-4778-a4d2-589b36c4ec59","Type":"ContainerStarted","Data":"e08d7648e8799808efc8dcefe346dc32017fe2f2c1f5f91297924855f1d3d980"}
Jul 02 12:48:49.677007 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:49.676987    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 12:48:49.679601 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:49.679581    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 12:48:50.020188 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:50.020134    2560 generic.go:356] "Generic (PLEG): container finished" podID="b9a255d4-963e-4778-a4d2-589b36c4ec59" containerID="e08d7648e8799808efc8dcefe346dc32017fe2f2c1f5f91297924855f1d3d980" exitCode=0
Jul 02 12:48:50.020188 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:50.020165    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mm69k" event={"ID":"b9a255d4-963e-4778-a4d2-589b36c4ec59","Type":"ContainerDied","Data":"e08d7648e8799808efc8dcefe346dc32017fe2f2c1f5f91297924855f1d3d980"}
Jul 02 12:48:54.642350 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:54.642326    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 02 12:48:55.041315 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:48:55.041233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mm69k" event={"ID":"b9a255d4-963e-4778-a4d2-589b36c4ec59","Type":"ContainerStarted","Data":"7218794a77199119c005dc5a982778ae3a4320e87298b0295542eb097d9db244"}
Jul 02 12:49:59.261693 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:49:59.261664    2560 generic.go:356] "Generic (PLEG): container finished" podID="b9a255d4-963e-4778-a4d2-589b36c4ec59" containerID="7218794a77199119c005dc5a982778ae3a4320e87298b0295542eb097d9db244" exitCode=0
Jul 02 12:49:59.262005 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:49:59.261705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mm69k" event={"ID":"b9a255d4-963e-4778-a4d2-589b36c4ec59","Type":"ContainerDied","Data":"7218794a77199119c005dc5a982778ae3a4320e87298b0295542eb097d9db244"}
Jul 02 12:50:00.385000 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:00.384973    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mm69k"
Jul 02 12:50:00.414213 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:00.414191    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9a255d4-963e-4778-a4d2-589b36c4ec59-model-cache\") pod \"b9a255d4-963e-4778-a4d2-589b36c4ec59\" (UID: \"b9a255d4-963e-4778-a4d2-589b36c4ec59\") "
Jul 02 12:50:00.414313 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:00.414235    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-667wx\" (UniqueName: \"kubernetes.io/projected/b9a255d4-963e-4778-a4d2-589b36c4ec59-kube-api-access-667wx\") pod \"b9a255d4-963e-4778-a4d2-589b36c4ec59\" (UID: \"b9a255d4-963e-4778-a4d2-589b36c4ec59\") "
Jul 02 12:50:00.416472 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:00.416422    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9a255d4-963e-4778-a4d2-589b36c4ec59-kube-api-access-667wx" (OuterVolumeSpecName: "kube-api-access-667wx") pod "b9a255d4-963e-4778-a4d2-589b36c4ec59" (UID: "b9a255d4-963e-4778-a4d2-589b36c4ec59"). InnerVolumeSpecName "kube-api-access-667wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 12:50:00.432553 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:00.432532    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9a255d4-963e-4778-a4d2-589b36c4ec59-model-cache" (OuterVolumeSpecName: "model-cache") pod "b9a255d4-963e-4778-a4d2-589b36c4ec59" (UID: "b9a255d4-963e-4778-a4d2-589b36c4ec59"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 12:50:00.514874 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:00.514848    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9a255d4-963e-4778-a4d2-589b36c4ec59-model-cache\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:50:00.514874 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:00.514867    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-667wx\" (UniqueName: \"kubernetes.io/projected/b9a255d4-963e-4778-a4d2-589b36c4ec59-kube-api-access-667wx\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:50:01.270405 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:01.270384    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mm69k"
Jul 02 12:50:01.270405 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:01.270388    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mm69k" event={"ID":"b9a255d4-963e-4778-a4d2-589b36c4ec59","Type":"ContainerDied","Data":"a169085ad56cedcf7d74b1fc2a34c39fcbed4892e202849a91e6e3b7490e07c5"}
Jul 02 12:50:01.270626 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:01.270417    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a169085ad56cedcf7d74b1fc2a34c39fcbed4892e202849a91e6e3b7490e07c5"
Jul 02 12:50:12.617274 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.617243    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"]
Jul 02 12:50:12.617632 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.617517    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9a255d4-963e-4778-a4d2-589b36c4ec59" containerName="s3-init"
Jul 02 12:50:12.617632 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.617532    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9a255d4-963e-4778-a4d2-589b36c4ec59" containerName="s3-init"
Jul 02 12:50:12.617632 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.617556    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9a255d4-963e-4778-a4d2-589b36c4ec59" containerName="download-hf-model"
Jul 02 12:50:12.617632 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.617562    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9a255d4-963e-4778-a4d2-589b36c4ec59" containerName="download-hf-model"
Jul 02 12:50:12.617632 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.617600    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9a255d4-963e-4778-a4d2-589b36c4ec59" containerName="s3-init"
Jul 02 12:50:12.620682 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.620665    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.626365 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.626337    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 02 12:50:12.626516 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.626370    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Jul 02 12:50:12.626590 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.626529    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-p74sx\""
Jul 02 12:50:12.626590 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.626573    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 02 12:50:12.626689 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.626553    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 02 12:50:12.626689 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.626635    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Jul 02 12:50:12.627179 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.627163    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 02 12:50:12.633374 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.633352    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"]
Jul 02 12:50:12.691953 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.691933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-228l8\" (UniqueName: \"kubernetes.io/projected/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-api-access-228l8\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.692063 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.691965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.692063 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.691986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.692063 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.692010    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.692063 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.692056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.792956 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.792934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.793062 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.792985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-228l8\" (UniqueName: \"kubernetes.io/projected/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-api-access-228l8\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.793062 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.793016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.793062 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.793036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.793062 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.793055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.793274 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:50:12.793254    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 02 12:50:12.793350 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:50:12.793338    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-proxy-tls podName:21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5 nodeName:}" failed. No retries permitted until 2026-07-02 12:50:13.293318277 +0000 UTC m=+684.025578668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-proxy-tls") pod "isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" (UID: "21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 02 12:50:12.793414 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.793392    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.793655 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.793639    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.793706 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.793673    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.804071 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.804053    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-228l8\" (UniqueName: \"kubernetes.io/projected/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-api-access-228l8\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:12.837785 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.837762    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"]
Jul 02 12:50:12.841180 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.841164    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.843921 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.843904    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\""
Jul 02 12:50:12.844185 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.844172    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\""
Jul 02 12:50:12.853369 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.853349    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"]
Jul 02 12:50:12.893603 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.893554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.893713 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.893607    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tsjm\" (UniqueName: \"kubernetes.io/projected/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-api-access-5tsjm\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.893713 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.893694    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.893828 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.893728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69f33241-5f5d-4f71-918f-5dfa102fd0fb-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.893828 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.893804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.994731 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.994705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.994834 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.994736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69f33241-5f5d-4f71-918f-5dfa102fd0fb-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.994834 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.994761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.994834 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.994780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.995018 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.994846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tsjm\" (UniqueName: \"kubernetes.io/projected/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-api-access-5tsjm\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.995018 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:50:12.994881    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found
Jul 02 12:50:12.995018 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:50:12.994938    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69f33241-5f5d-4f71-918f-5dfa102fd0fb-proxy-tls podName:69f33241-5f5d-4f71-918f-5dfa102fd0fb nodeName:}" failed. No retries permitted until 2026-07-02 12:50:13.494920395 +0000 UTC m=+684.227180795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/69f33241-5f5d-4f71-918f-5dfa102fd0fb-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-jt9qq" (UID: "69f33241-5f5d-4f71-918f-5dfa102fd0fb") : secret "isvc-xgboost-graph-predictor-serving-cert" not found
Jul 02 12:50:12.995174 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.995150    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.995475 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.995458    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:12.995528 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:12.995456    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:13.004638 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:13.004615    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tsjm\" (UniqueName: \"kubernetes.io/projected/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-api-access-5tsjm\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:13.298229 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:13.298177    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:13.300316 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:13.300300    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:13.500109 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:13.500085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69f33241-5f5d-4f71-918f-5dfa102fd0fb-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:13.502131 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:13.502113    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69f33241-5f5d-4f71-918f-5dfa102fd0fb-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-jt9qq\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:13.536007 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:13.535985    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:13.655225 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:13.655204    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"]
Jul 02 12:50:13.656916 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:50:13.656892    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f5a1ae_7b3c_468f_95c7_a90dcb90c4c5.slice/crio-4e1c24a109807e8513227af841bc04d5d7c3305dde0af5ea3c45cac4f47c6b77 WatchSource:0}: Error finding container 4e1c24a109807e8513227af841bc04d5d7c3305dde0af5ea3c45cac4f47c6b77: Status 404 returned error can't find the container with id 4e1c24a109807e8513227af841bc04d5d7c3305dde0af5ea3c45cac4f47c6b77
Jul 02 12:50:13.751063 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:13.751032    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:13.900012 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:13.899987    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"]
Jul 02 12:50:13.902156 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:50:13.902129    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f33241_5f5d_4f71_918f_5dfa102fd0fb.slice/crio-6544859e9c5e3954f4f6e589bf808fc901b1987979af27e740bb58ede69b36b4 WatchSource:0}: Error finding container 6544859e9c5e3954f4f6e589bf808fc901b1987979af27e740bb58ede69b36b4: Status 404 returned error can't find the container with id 6544859e9c5e3954f4f6e589bf808fc901b1987979af27e740bb58ede69b36b4
Jul 02 12:50:14.316916 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:14.316832    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" event={"ID":"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5","Type":"ContainerStarted","Data":"e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb"}
Jul 02 12:50:14.316916 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:14.316894    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" event={"ID":"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5","Type":"ContainerStarted","Data":"4e1c24a109807e8513227af841bc04d5d7c3305dde0af5ea3c45cac4f47c6b77"}
Jul 02 12:50:14.318447 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:14.318409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" event={"ID":"69f33241-5f5d-4f71-918f-5dfa102fd0fb","Type":"ContainerStarted","Data":"f590fa1486dc80f40abddfb4776683950a73aeef0afb1e38ac5158619f695e19"}
Jul 02 12:50:14.318552 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:14.318485    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" event={"ID":"69f33241-5f5d-4f71-918f-5dfa102fd0fb","Type":"ContainerStarted","Data":"6544859e9c5e3954f4f6e589bf808fc901b1987979af27e740bb58ede69b36b4"}
Jul 02 12:50:18.334701 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:18.334669    2560 generic.go:356] "Generic (PLEG): container finished" podID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerID="e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb" exitCode=0
Jul 02 12:50:18.335063 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:18.334736    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" event={"ID":"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5","Type":"ContainerDied","Data":"e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb"}
Jul 02 12:50:18.336420 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:18.336402    2560 generic.go:356] "Generic (PLEG): container finished" podID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerID="f590fa1486dc80f40abddfb4776683950a73aeef0afb1e38ac5158619f695e19" exitCode=0
Jul 02 12:50:18.336505 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:18.336457    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" event={"ID":"69f33241-5f5d-4f71-918f-5dfa102fd0fb","Type":"ContainerDied","Data":"f590fa1486dc80f40abddfb4776683950a73aeef0afb1e38ac5158619f695e19"}
Jul 02 12:50:42.456460 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:42.456417    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" event={"ID":"69f33241-5f5d-4f71-918f-5dfa102fd0fb","Type":"ContainerStarted","Data":"2b2d0e0afd05469fad950424a90ddf11079ca8c075491b4501f59803064bb2dc"}
Jul 02 12:50:42.457977 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:42.457949    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" event={"ID":"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5","Type":"ContainerStarted","Data":"2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7"}
Jul 02 12:50:45.475734 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:45.475695    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" event={"ID":"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5","Type":"ContainerStarted","Data":"d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1"}
Jul 02 12:50:45.476195 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:45.475765    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:45.476195 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:45.475861    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:45.477334 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:45.477305    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 02 12:50:45.478167 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:45.478146    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" event={"ID":"69f33241-5f5d-4f71-918f-5dfa102fd0fb","Type":"ContainerStarted","Data":"23bb913eb4da6d908f5341c133ecae746c2641f2314826234668812114ff904b"}
Jul 02 12:50:45.478274 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:45.478259    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:45.499914 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:45.499876    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podStartSLOduration=3.1781106709999998 podStartE2EDuration="33.499863816s" totalImagesPullingTime="26.442045855s" totalInitContainerRuntime="3.87970729s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:50:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:50:45.499281661 +0000 UTC m=+716.231542070" watchObservedRunningTime="2026-07-02 12:50:45.499863816 +0000 UTC m=+716.232124225"
Jul 02 12:50:45.521368 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:45.521328    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" podStartSLOduration=3.338055351 podStartE2EDuration="33.521316241s" totalImagesPullingTime="26.445311873s" totalInitContainerRuntime="3.737949017s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:50:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:50:45.520251048 +0000 UTC m=+716.252511477" watchObservedRunningTime="2026-07-02 12:50:45.521316241 +0000 UTC m=+716.253576660"
Jul 02 12:50:46.483444 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:46.483383    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 02 12:50:46.483910 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:46.483737    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:46.484358 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:46.484332    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Jul 02 12:50:47.487760 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:47.487714    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Jul 02 12:50:51.491629 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:51.491603    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:50:51.492115 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:51.492090    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 02 12:50:52.492845 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:52.492818    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:50:52.493449 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:50:52.493409    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Jul 02 12:51:01.492199 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:51:01.492163    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 02 12:51:02.493649 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:51:02.493613    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Jul 02 12:51:11.492036 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:51:11.491997    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 02 12:51:12.493854 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:51:12.493815    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Jul 02 12:51:21.492182 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:51:21.492140    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 02 12:51:22.493726 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:51:22.493686    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Jul 02 12:51:31.492207 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:51:31.492170    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 02 12:51:32.493477 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:51:32.493400    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Jul 02 12:51:41.492615 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:51:41.492579    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused"
Jul 02 12:51:42.494069 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:51:42.494043    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:51:51.493386 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:51:51.493358    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:52:12.467385 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:12.467314    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"]
Jul 02 12:52:12.469521 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:12.469508    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:12.472156 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:12.472138    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Jul 02 12:52:12.472156 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:12.472138    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Jul 02 12:52:12.481496 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:12.481476    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"]
Jul 02 12:52:12.586500 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:12.586478    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c57f64d-b239-4f40-b2cb-b204401c2570-proxy-tls\") pod \"model-chainer-786fb4fbc7-6glcm\" (UID: \"8c57f64d-b239-4f40-b2cb-b204401c2570\") " pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:12.586614 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:12.586536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c57f64d-b239-4f40-b2cb-b204401c2570-openshift-service-ca-bundle\") pod \"model-chainer-786fb4fbc7-6glcm\" (UID: \"8c57f64d-b239-4f40-b2cb-b204401c2570\") " pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:12.686914 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:12.686881    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c57f64d-b239-4f40-b2cb-b204401c2570-openshift-service-ca-bundle\") pod \"model-chainer-786fb4fbc7-6glcm\" (UID: \"8c57f64d-b239-4f40-b2cb-b204401c2570\") " pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:12.687016 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:12.686933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c57f64d-b239-4f40-b2cb-b204401c2570-proxy-tls\") pod \"model-chainer-786fb4fbc7-6glcm\" (UID: \"8c57f64d-b239-4f40-b2cb-b204401c2570\") " pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:12.687055 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:52:12.687030    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-serving-cert: secret "model-chainer-serving-cert" not found
Jul 02 12:52:12.687089 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:52:12.687081    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c57f64d-b239-4f40-b2cb-b204401c2570-proxy-tls podName:8c57f64d-b239-4f40-b2cb-b204401c2570 nodeName:}" failed. No retries permitted until 2026-07-02 12:52:13.187068194 +0000 UTC m=+803.919328580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/8c57f64d-b239-4f40-b2cb-b204401c2570-proxy-tls") pod "model-chainer-786fb4fbc7-6glcm" (UID: "8c57f64d-b239-4f40-b2cb-b204401c2570") : secret "model-chainer-serving-cert" not found
Jul 02 12:52:12.687491 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:12.687476    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c57f64d-b239-4f40-b2cb-b204401c2570-openshift-service-ca-bundle\") pod \"model-chainer-786fb4fbc7-6glcm\" (UID: \"8c57f64d-b239-4f40-b2cb-b204401c2570\") " pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:13.188591 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:13.188561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c57f64d-b239-4f40-b2cb-b204401c2570-proxy-tls\") pod \"model-chainer-786fb4fbc7-6glcm\" (UID: \"8c57f64d-b239-4f40-b2cb-b204401c2570\") " pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:13.190972 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:13.190944    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c57f64d-b239-4f40-b2cb-b204401c2570-proxy-tls\") pod \"model-chainer-786fb4fbc7-6glcm\" (UID: \"8c57f64d-b239-4f40-b2cb-b204401c2570\") " pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:13.379364 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:13.379343    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:13.497485 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:13.497460    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"]
Jul 02 12:52:13.499662 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:52:13.499633    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c57f64d_b239_4f40_b2cb_b204401c2570.slice/crio-3144334cbd0b8c072d9288c6240b7a74527b6b049486e769a6258039e25934c9 WatchSource:0}: Error finding container 3144334cbd0b8c072d9288c6240b7a74527b6b049486e769a6258039e25934c9: Status 404 returned error can't find the container with id 3144334cbd0b8c072d9288c6240b7a74527b6b049486e769a6258039e25934c9
Jul 02 12:52:13.800528 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:13.792287    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" event={"ID":"8c57f64d-b239-4f40-b2cb-b204401c2570","Type":"ContainerStarted","Data":"3144334cbd0b8c072d9288c6240b7a74527b6b049486e769a6258039e25934c9"}
Jul 02 12:52:15.800793 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:15.800711    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" event={"ID":"8c57f64d-b239-4f40-b2cb-b204401c2570","Type":"ContainerStarted","Data":"dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d"}
Jul 02 12:52:15.801120 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:15.800794    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:15.818409 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:15.818367    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" podStartSLOduration=1.8096702260000002 podStartE2EDuration="3.818354863s" totalImagesPullingTime="2.008684637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:52:15.816563801 +0000 UTC m=+806.548824232" watchObservedRunningTime="2026-07-02 12:52:15.818354863 +0000 UTC m=+806.550615272"
Jul 02 12:52:21.809211 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:21.809184    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:22.569015 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:22.568986    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"]
Jul 02 12:52:22.569239 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:22.569215    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" podUID="8c57f64d-b239-4f40-b2cb-b204401c2570" containerName="model-chainer" containerID="cri-o://dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d" gracePeriod=30
Jul 02 12:52:22.748286 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:22.748255    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"]
Jul 02 12:52:22.748561 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:22.748538    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container" containerID="cri-o://2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7" gracePeriod=30
Jul 02 12:52:22.748672 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:22.748572    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kube-rbac-proxy" containerID="cri-o://d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1" gracePeriod=30
Jul 02 12:52:22.912337 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:22.912305    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"]
Jul 02 12:52:22.912668 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:22.912543    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kserve-container" containerID="cri-o://2b2d0e0afd05469fad950424a90ddf11079ca8c075491b4501f59803064bb2dc" gracePeriod=30
Jul 02 12:52:22.912668 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:22.912563    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kube-rbac-proxy" containerID="cri-o://23bb913eb4da6d908f5341c133ecae746c2641f2314826234668812114ff904b" gracePeriod=30
Jul 02 12:52:23.831174 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:23.831145    2560 generic.go:356] "Generic (PLEG): container finished" podID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerID="d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1" exitCode=2
Jul 02 12:52:23.831344 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:23.831216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" event={"ID":"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5","Type":"ContainerDied","Data":"d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1"}
Jul 02 12:52:23.832947 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:23.832923    2560 generic.go:356] "Generic (PLEG): container finished" podID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerID="23bb913eb4da6d908f5341c133ecae746c2641f2314826234668812114ff904b" exitCode=2
Jul 02 12:52:23.833044 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:23.832964    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" event={"ID":"69f33241-5f5d-4f71-918f-5dfa102fd0fb","Type":"ContainerDied","Data":"23bb913eb4da6d908f5341c133ecae746c2641f2314826234668812114ff904b"}
Jul 02 12:52:25.843104 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.843078    2560 generic.go:356] "Generic (PLEG): container finished" podID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerID="2b2d0e0afd05469fad950424a90ddf11079ca8c075491b4501f59803064bb2dc" exitCode=0
Jul 02 12:52:25.843404 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.843144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" event={"ID":"69f33241-5f5d-4f71-918f-5dfa102fd0fb","Type":"ContainerDied","Data":"2b2d0e0afd05469fad950424a90ddf11079ca8c075491b4501f59803064bb2dc"}
Jul 02 12:52:25.843404 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.843196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq" event={"ID":"69f33241-5f5d-4f71-918f-5dfa102fd0fb","Type":"ContainerDied","Data":"6544859e9c5e3954f4f6e589bf808fc901b1987979af27e740bb58ede69b36b4"}
Jul 02 12:52:25.843404 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.843216    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6544859e9c5e3954f4f6e589bf808fc901b1987979af27e740bb58ede69b36b4"
Jul 02 12:52:25.844321 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.844306    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:52:25.888374 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.888354    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tsjm\" (UniqueName: \"kubernetes.io/projected/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-api-access-5tsjm\") pod \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") "
Jul 02 12:52:25.888501 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.888382    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kserve-provision-location\") pod \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") "
Jul 02 12:52:25.888501 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.888405    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69f33241-5f5d-4f71-918f-5dfa102fd0fb-proxy-tls\") pod \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") "
Jul 02 12:52:25.888612 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.888545    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-cabundle-cert\") pod \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") "
Jul 02 12:52:25.888673 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.888610    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-rbac-proxy-sar-config\") pod \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\" (UID: \"69f33241-5f5d-4f71-918f-5dfa102fd0fb\") "
Jul 02 12:52:25.888811 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.888779    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "69f33241-5f5d-4f71-918f-5dfa102fd0fb" (UID: "69f33241-5f5d-4f71-918f-5dfa102fd0fb"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 12:52:25.888917 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.888855    2560 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kserve-provision-location\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:25.888965 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.888914    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "69f33241-5f5d-4f71-918f-5dfa102fd0fb" (UID: "69f33241-5f5d-4f71-918f-5dfa102fd0fb"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:52:25.888965 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.888942    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "69f33241-5f5d-4f71-918f-5dfa102fd0fb" (UID: "69f33241-5f5d-4f71-918f-5dfa102fd0fb"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:52:25.891070 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.891051    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69f33241-5f5d-4f71-918f-5dfa102fd0fb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "69f33241-5f5d-4f71-918f-5dfa102fd0fb" (UID: "69f33241-5f5d-4f71-918f-5dfa102fd0fb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:52:25.891130 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.891053    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-api-access-5tsjm" (OuterVolumeSpecName: "kube-api-access-5tsjm") pod "69f33241-5f5d-4f71-918f-5dfa102fd0fb" (UID: "69f33241-5f5d-4f71-918f-5dfa102fd0fb"). InnerVolumeSpecName "kube-api-access-5tsjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 12:52:25.989276 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.989227    2560 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-cabundle-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:25.989276 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.989245    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:25.989276 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.989254    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tsjm\" (UniqueName: \"kubernetes.io/projected/69f33241-5f5d-4f71-918f-5dfa102fd0fb-kube-api-access-5tsjm\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:25.989276 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:25.989263    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69f33241-5f5d-4f71-918f-5dfa102fd0fb-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:26.484084 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.484043    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.21:8643/healthz\": dial tcp 10.133.0.21:8643: connect: connection refused"
Jul 02 12:52:26.790834 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.790812    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:52:26.808303 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.808270    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" podUID="8c57f64d-b239-4f40-b2cb-b204401c2570" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 12:52:26.849074 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.849049    2560 generic.go:356] "Generic (PLEG): container finished" podID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerID="2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7" exitCode=0
Jul 02 12:52:26.849352 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.849103    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"
Jul 02 12:52:26.849352 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.849127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" event={"ID":"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5","Type":"ContainerDied","Data":"2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7"}
Jul 02 12:52:26.849352 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.849194    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg" event={"ID":"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5","Type":"ContainerDied","Data":"4e1c24a109807e8513227af841bc04d5d7c3305dde0af5ea3c45cac4f47c6b77"}
Jul 02 12:52:26.849352 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.849233    2560 scope.go:117] "RemoveContainer" containerID="d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1"
Jul 02 12:52:26.849352 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.849297    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"
Jul 02 12:52:26.860284 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.860257    2560 scope.go:117] "RemoveContainer" containerID="2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7"
Jul 02 12:52:26.867058 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.867041    2560 scope.go:117] "RemoveContainer" containerID="e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb"
Jul 02 12:52:26.872587 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.872565    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"]
Jul 02 12:52:26.873951 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.873937    2560 scope.go:117] "RemoveContainer" containerID="d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1"
Jul 02 12:52:26.874192 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:52:26.874173    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1\": container with ID starting with d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1 not found: ID does not exist" containerID="d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1"
Jul 02 12:52:26.874234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.874201    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1"} err="failed to get container status \"d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1\": rpc error: code = NotFound desc = could not find container \"d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1\": container with ID starting with d5d64797d8dcca5f550e4ebcaea9684e7d6f42ff43e384414f2b24121497dad1 not found: ID does not exist"
Jul 02 12:52:26.874234 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.874217    2560 scope.go:117] "RemoveContainer" containerID="2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7"
Jul 02 12:52:26.874473 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:52:26.874454    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7\": container with ID starting with 2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7 not found: ID does not exist" containerID="2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7"
Jul 02 12:52:26.874529 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.874480    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7"} err="failed to get container status \"2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7\": rpc error: code = NotFound desc = could not find container \"2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7\": container with ID starting with 2871b975b56cd56018b4be555e93195f3898f380a90e2c9264cda623e93897a7 not found: ID does not exist"
Jul 02 12:52:26.874529 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.874500    2560 scope.go:117] "RemoveContainer" containerID="e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb"
Jul 02 12:52:26.874729 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:52:26.874713    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb\": container with ID starting with e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb not found: ID does not exist" containerID="e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb"
Jul 02 12:52:26.874772 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.874732    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb"} err="failed to get container status \"e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb\": rpc error: code = NotFound desc = could not find container \"e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb\": container with ID starting with e0318937281d021eb0105211fa7927b9e5c6e0272d83d47c45d3c2815aa4d8fb not found: ID does not exist"
Jul 02 12:52:26.877004 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.876980    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jt9qq"]
Jul 02 12:52:26.895027 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.895008    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-cabundle-cert\") pod \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") "
Jul 02 12:52:26.895108 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.895047    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-rbac-proxy-sar-config\") pod \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") "
Jul 02 12:52:26.895108 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.895069    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-228l8\" (UniqueName: \"kubernetes.io/projected/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-api-access-228l8\") pod \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") "
Jul 02 12:52:26.895108 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.895084    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-proxy-tls\") pod \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") "
Jul 02 12:52:26.895250 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.895118    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kserve-provision-location\") pod \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\" (UID: \"21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5\") "
Jul 02 12:52:26.895360 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.895329    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" (UID: "21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:52:26.895470 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.895382    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" (UID: "21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:52:26.895548 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.895499    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" (UID: "21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 12:52:26.896981 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.896953    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" (UID: "21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:52:26.897098 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.897083    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-api-access-228l8" (OuterVolumeSpecName: "kube-api-access-228l8") pod "21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" (UID: "21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5"). InnerVolumeSpecName "kube-api-access-228l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 12:52:26.995541 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.995519    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:26.995541 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.995537    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-228l8\" (UniqueName: \"kubernetes.io/projected/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kube-api-access-228l8\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:26.995656 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.995547    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:26.995656 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.995556    2560 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-kserve-provision-location\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:26.995656 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:26.995565    2560 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5-cabundle-cert\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:27.172509 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:27.172486    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"]
Jul 02 12:52:27.179422 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:27.176559    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-786f6957cf-wv9rg"]
Jul 02 12:52:27.705890 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:27.705860    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" path="/var/lib/kubelet/pods/21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5/volumes"
Jul 02 12:52:27.706330 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:27.706317    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" path="/var/lib/kubelet/pods/69f33241-5f5d-4f71-918f-5dfa102fd0fb/volumes"
Jul 02 12:52:31.808771 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:31.808737    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" podUID="8c57f64d-b239-4f40-b2cb-b204401c2570" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 12:52:36.807822 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:36.807788    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" podUID="8c57f64d-b239-4f40-b2cb-b204401c2570" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 12:52:36.808165 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:36.807884    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:41.807833 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:41.807793    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" podUID="8c57f64d-b239-4f40-b2cb-b204401c2570" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 12:52:42.875213 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875186    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"]
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875479    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kube-rbac-proxy"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875491    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kube-rbac-proxy"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875502    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="storage-initializer"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875508    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="storage-initializer"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875516    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kube-rbac-proxy"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875523    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kube-rbac-proxy"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875533    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="storage-initializer"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875541    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="storage-initializer"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875548    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875554    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875560    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kserve-container"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875565    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kserve-container"
Jul 02 12:52:42.875604 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875606    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kserve-container"
Jul 02 12:52:42.876019 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875615    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kube-rbac-proxy"
Jul 02 12:52:42.876019 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875621    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="69f33241-5f5d-4f71-918f-5dfa102fd0fb" containerName="kserve-container"
Jul 02 12:52:42.876019 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.875627    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f5a1ae-7b3c-468f-95c7-a90dcb90c4c5" containerName="kube-rbac-proxy"
Jul 02 12:52:42.878469 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.878453    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 12:52:42.881250 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.881224    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-04e3b-serving-cert\""
Jul 02 12:52:42.881394 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.881360    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-04e3b-kube-rbac-proxy-sar-config\""
Jul 02 12:52:42.888632 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.888610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"]
Jul 02 12:52:42.891850 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.891830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8999b35d-3e41-4baa-928c-cdbeef1a73f5-openshift-service-ca-bundle\") pod \"switch-graph-04e3b-866d4fb65f-xqsz9\" (UID: \"8999b35d-3e41-4baa-928c-cdbeef1a73f5\") " pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 12:52:42.891929 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.891866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8999b35d-3e41-4baa-928c-cdbeef1a73f5-proxy-tls\") pod \"switch-graph-04e3b-866d4fb65f-xqsz9\" (UID: \"8999b35d-3e41-4baa-928c-cdbeef1a73f5\") " pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 12:52:42.992159 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.992136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8999b35d-3e41-4baa-928c-cdbeef1a73f5-openshift-service-ca-bundle\") pod \"switch-graph-04e3b-866d4fb65f-xqsz9\" (UID: \"8999b35d-3e41-4baa-928c-cdbeef1a73f5\") " pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 12:52:42.992253 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.992171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8999b35d-3e41-4baa-928c-cdbeef1a73f5-proxy-tls\") pod \"switch-graph-04e3b-866d4fb65f-xqsz9\" (UID: \"8999b35d-3e41-4baa-928c-cdbeef1a73f5\") " pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 12:52:42.992724 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.992704    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8999b35d-3e41-4baa-928c-cdbeef1a73f5-openshift-service-ca-bundle\") pod \"switch-graph-04e3b-866d4fb65f-xqsz9\" (UID: \"8999b35d-3e41-4baa-928c-cdbeef1a73f5\") " pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 12:52:42.994508 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:42.994483    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8999b35d-3e41-4baa-928c-cdbeef1a73f5-proxy-tls\") pod \"switch-graph-04e3b-866d4fb65f-xqsz9\" (UID: \"8999b35d-3e41-4baa-928c-cdbeef1a73f5\") " pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 12:52:43.188041 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:43.187993    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 12:52:43.308959 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:43.308935    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"]
Jul 02 12:52:43.311623 ip-10-0-128-177 kubenswrapper[2560]: W0702 12:52:43.311590    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8999b35d_3e41_4baa_928c_cdbeef1a73f5.slice/crio-bed7547016ed138cde82b0834efeb8940a7f4fe9333f28b6d9ed5302de3d18b9 WatchSource:0}: Error finding container bed7547016ed138cde82b0834efeb8940a7f4fe9333f28b6d9ed5302de3d18b9: Status 404 returned error can't find the container with id bed7547016ed138cde82b0834efeb8940a7f4fe9333f28b6d9ed5302de3d18b9
Jul 02 12:52:43.909804 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:43.909775    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" event={"ID":"8999b35d-3e41-4baa-928c-cdbeef1a73f5","Type":"ContainerStarted","Data":"d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328"}
Jul 02 12:52:43.910238 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:43.909823    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" event={"ID":"8999b35d-3e41-4baa-928c-cdbeef1a73f5","Type":"ContainerStarted","Data":"bed7547016ed138cde82b0834efeb8940a7f4fe9333f28b6d9ed5302de3d18b9"}
Jul 02 12:52:43.910238 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:43.909975    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 12:52:43.927324 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:43.927282    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" podStartSLOduration=1.927268718 podStartE2EDuration="1.927268718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:52:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:52:43.927059401 +0000 UTC m=+834.659319809" watchObservedRunningTime="2026-07-02 12:52:43.927268718 +0000 UTC m=+834.659529126"
Jul 02 12:52:46.808381 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:46.808347    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" podUID="8c57f64d-b239-4f40-b2cb-b204401c2570" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 12:52:49.919067 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:49.919037    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 12:52:51.807638 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:51.807605    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" podUID="8c57f64d-b239-4f40-b2cb-b204401c2570" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 12:52:52.700954 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.700931    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:52.761712 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.761693    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c57f64d-b239-4f40-b2cb-b204401c2570-proxy-tls\") pod \"8c57f64d-b239-4f40-b2cb-b204401c2570\" (UID: \"8c57f64d-b239-4f40-b2cb-b204401c2570\") "
Jul 02 12:52:52.761814 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.761733    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c57f64d-b239-4f40-b2cb-b204401c2570-openshift-service-ca-bundle\") pod \"8c57f64d-b239-4f40-b2cb-b204401c2570\" (UID: \"8c57f64d-b239-4f40-b2cb-b204401c2570\") "
Jul 02 12:52:52.762131 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.762104    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c57f64d-b239-4f40-b2cb-b204401c2570-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "8c57f64d-b239-4f40-b2cb-b204401c2570" (UID: "8c57f64d-b239-4f40-b2cb-b204401c2570"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 12:52:52.763638 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.763620    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c57f64d-b239-4f40-b2cb-b204401c2570-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8c57f64d-b239-4f40-b2cb-b204401c2570" (UID: "8c57f64d-b239-4f40-b2cb-b204401c2570"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 12:52:52.863140 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.863118    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c57f64d-b239-4f40-b2cb-b204401c2570-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:52.863140 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.863137    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c57f64d-b239-4f40-b2cb-b204401c2570-openshift-service-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 12:52:52.942627 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.942598    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c57f64d-b239-4f40-b2cb-b204401c2570" containerID="dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d" exitCode=0
Jul 02 12:52:52.942730 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.942638    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"
Jul 02 12:52:52.942730 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.942684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" event={"ID":"8c57f64d-b239-4f40-b2cb-b204401c2570","Type":"ContainerDied","Data":"dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d"}
Jul 02 12:52:52.942730 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.942729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm" event={"ID":"8c57f64d-b239-4f40-b2cb-b204401c2570","Type":"ContainerDied","Data":"3144334cbd0b8c072d9288c6240b7a74527b6b049486e769a6258039e25934c9"}
Jul 02 12:52:52.942865 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.942750    2560 scope.go:117] "RemoveContainer" containerID="dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d"
Jul 02 12:52:52.950862 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.950838    2560 scope.go:117] "RemoveContainer" containerID="dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d"
Jul 02 12:52:52.951101 ip-10-0-128-177 kubenswrapper[2560]: E0702 12:52:52.951085    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d\": container with ID starting with dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d not found: ID does not exist" containerID="dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d"
Jul 02 12:52:52.951173 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.951112    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d"} err="failed to get container status \"dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d\": rpc error: code = NotFound desc = could not find container \"dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d\": container with ID starting with dcca0744b8cff573249cecf721db642b3690348627e57c08919592fb3929ee7d not found: ID does not exist"
Jul 02 12:52:52.967698 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.967678    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"]
Jul 02 12:52:52.972181 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:52.972163    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-786fb4fbc7-6glcm"]
Jul 02 12:52:53.704670 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:52:53.704640    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c57f64d-b239-4f40-b2cb-b204401c2570" path="/var/lib/kubelet/pods/8c57f64d-b239-4f40-b2cb-b204401c2570/volumes"
Jul 02 12:53:22.794985 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.794954    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"]
Jul 02 12:53:22.795451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.795207    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c57f64d-b239-4f40-b2cb-b204401c2570" containerName="model-chainer"
Jul 02 12:53:22.795451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.795218    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c57f64d-b239-4f40-b2cb-b204401c2570" containerName="model-chainer"
Jul 02 12:53:22.795451 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.795284    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c57f64d-b239-4f40-b2cb-b204401c2570" containerName="model-chainer"
Jul 02 12:53:22.797099 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.797084    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 12:53:22.805251 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.805233    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8bebb-serving-cert\""
Jul 02 12:53:22.805539 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.805524    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8bebb-kube-rbac-proxy-sar-config\""
Jul 02 12:53:22.816914 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.816890    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"]
Jul 02 12:53:22.862160 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.862139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/989e2bc5-363e-451f-8eb5-68fc40607d99-openshift-service-ca-bundle\") pod \"sequence-graph-8bebb-86485cbd97-g4qmq\" (UID: \"989e2bc5-363e-451f-8eb5-68fc40607d99\") " pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 12:53:22.862244 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.862169    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/989e2bc5-363e-451f-8eb5-68fc40607d99-proxy-tls\") pod \"sequence-graph-8bebb-86485cbd97-g4qmq\" (UID: \"989e2bc5-363e-451f-8eb5-68fc40607d99\") " pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 12:53:22.963427 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.963404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/989e2bc5-363e-451f-8eb5-68fc40607d99-openshift-service-ca-bundle\") pod \"sequence-graph-8bebb-86485cbd97-g4qmq\" (UID: \"989e2bc5-363e-451f-8eb5-68fc40607d99\") " pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 12:53:22.963535 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.963463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/989e2bc5-363e-451f-8eb5-68fc40607d99-proxy-tls\") pod \"sequence-graph-8bebb-86485cbd97-g4qmq\" (UID: \"989e2bc5-363e-451f-8eb5-68fc40607d99\") " pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 12:53:22.963983 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.963958    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/989e2bc5-363e-451f-8eb5-68fc40607d99-openshift-service-ca-bundle\") pod \"sequence-graph-8bebb-86485cbd97-g4qmq\" (UID: \"989e2bc5-363e-451f-8eb5-68fc40607d99\") " pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 12:53:22.965685 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:22.965668    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/989e2bc5-363e-451f-8eb5-68fc40607d99-proxy-tls\") pod \"sequence-graph-8bebb-86485cbd97-g4qmq\" (UID: \"989e2bc5-363e-451f-8eb5-68fc40607d99\") " pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 12:53:23.106508 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:23.106488    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 12:53:23.232468 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:23.231281    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"]
Jul 02 12:53:24.053643 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:24.053607    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" event={"ID":"989e2bc5-363e-451f-8eb5-68fc40607d99","Type":"ContainerStarted","Data":"b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd"}
Jul 02 12:53:24.054008 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:24.053664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" event={"ID":"989e2bc5-363e-451f-8eb5-68fc40607d99","Type":"ContainerStarted","Data":"c311baf3dd960a97b8525846eecd3fbc94b38cd756b26e93a00ddf5b09e84904"}
Jul 02 12:53:24.054008 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:24.053699    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 12:53:24.080254 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:24.080207    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" podStartSLOduration=2.080195154 podStartE2EDuration="2.080195154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:53:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:53:24.077299858 +0000 UTC m=+874.809560266" watchObservedRunningTime="2026-07-02 12:53:24.080195154 +0000 UTC m=+874.812455562"
Jul 02 12:53:30.063682 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:30.063652    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 12:53:49.700058 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:49.700032    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 12:53:49.701677 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:53:49.701652    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 12:56:49.741986 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:56:49.741957    2560 scope.go:117] "RemoveContainer" containerID="23bb913eb4da6d908f5341c133ecae746c2641f2314826234668812114ff904b"
Jul 02 12:56:49.749411 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:56:49.749395    2560 scope.go:117] "RemoveContainer" containerID="f590fa1486dc80f40abddfb4776683950a73aeef0afb1e38ac5158619f695e19"
Jul 02 12:56:49.756292 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:56:49.756277    2560 scope.go:117] "RemoveContainer" containerID="2b2d0e0afd05469fad950424a90ddf11079ca8c075491b4501f59803064bb2dc"
Jul 02 12:58:49.721811 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:58:49.721783    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 12:58:49.724552 ip-10-0-128-177 kubenswrapper[2560]: I0702 12:58:49.724534    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:00:57.446921 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:00:57.446888    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"]
Jul 02 13:00:57.447419 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:00:57.447081    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" podUID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" containerName="switch-graph-04e3b" containerID="cri-o://d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328" gracePeriod=30
Jul 02 13:00:59.918558 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:00:59.918517    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" podUID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" containerName="switch-graph-04e3b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:01:04.917754 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:04.917714    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" podUID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" containerName="switch-graph-04e3b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:01:09.917546 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:09.917505    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" podUID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" containerName="switch-graph-04e3b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:01:09.918012 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:09.917604    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 13:01:14.917510 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:14.917466    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" podUID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" containerName="switch-graph-04e3b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:01:19.918181 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:19.918141    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" podUID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" containerName="switch-graph-04e3b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:01:24.917929 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:24.917885    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" podUID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" containerName="switch-graph-04e3b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:01:27.635611 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.635586    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 13:01:27.684800 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.684766    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8999b35d-3e41-4baa-928c-cdbeef1a73f5-openshift-service-ca-bundle\") pod \"8999b35d-3e41-4baa-928c-cdbeef1a73f5\" (UID: \"8999b35d-3e41-4baa-928c-cdbeef1a73f5\") "
Jul 02 13:01:27.684956 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.684814    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8999b35d-3e41-4baa-928c-cdbeef1a73f5-proxy-tls\") pod \"8999b35d-3e41-4baa-928c-cdbeef1a73f5\" (UID: \"8999b35d-3e41-4baa-928c-cdbeef1a73f5\") "
Jul 02 13:01:27.685202 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.685177    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8999b35d-3e41-4baa-928c-cdbeef1a73f5-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "8999b35d-3e41-4baa-928c-cdbeef1a73f5" (UID: "8999b35d-3e41-4baa-928c-cdbeef1a73f5"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 13:01:27.686891 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.686861    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8999b35d-3e41-4baa-928c-cdbeef1a73f5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8999b35d-3e41-4baa-928c-cdbeef1a73f5" (UID: "8999b35d-3e41-4baa-928c-cdbeef1a73f5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 13:01:27.781573 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.781532    2560 generic.go:356] "Generic (PLEG): container finished" podID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" containerID="d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328" exitCode=0
Jul 02 13:01:27.781573 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.781577    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"
Jul 02 13:01:27.781764 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.781585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" event={"ID":"8999b35d-3e41-4baa-928c-cdbeef1a73f5","Type":"ContainerDied","Data":"d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328"}
Jul 02 13:01:27.781764 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.781645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9" event={"ID":"8999b35d-3e41-4baa-928c-cdbeef1a73f5","Type":"ContainerDied","Data":"bed7547016ed138cde82b0834efeb8940a7f4fe9333f28b6d9ed5302de3d18b9"}
Jul 02 13:01:27.781764 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.781669    2560 scope.go:117] "RemoveContainer" containerID="d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328"
Jul 02 13:01:27.785801 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.785777    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8999b35d-3e41-4baa-928c-cdbeef1a73f5-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:01:27.785917 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.785807    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8999b35d-3e41-4baa-928c-cdbeef1a73f5-openshift-service-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:01:27.789415 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.789396    2560 scope.go:117] "RemoveContainer" containerID="d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328"
Jul 02 13:01:27.789713 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:01:27.789695    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328\": container with ID starting with d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328 not found: ID does not exist" containerID="d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328"
Jul 02 13:01:27.789762 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.789725    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328"} err="failed to get container status \"d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328\": rpc error: code = NotFound desc = could not find container \"d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328\": container with ID starting with d2b2980761f426d9629ef61a94950dd061f9bfd99eb30f13b1abf776ba51b328 not found: ID does not exist"
Jul 02 13:01:27.801128 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.801106    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"]
Jul 02 13:01:27.805490 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:27.805472    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-04e3b-866d4fb65f-xqsz9"]
Jul 02 13:01:29.704848 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:29.704818    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" path="/var/lib/kubelet/pods/8999b35d-3e41-4baa-928c-cdbeef1a73f5/volumes"
Jul 02 13:01:47.526562 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:47.526529    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"]
Jul 02 13:01:47.526976 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:47.526729    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" podUID="989e2bc5-363e-451f-8eb5-68fc40607d99" containerName="sequence-graph-8bebb" containerID="cri-o://b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd" gracePeriod=30
Jul 02 13:01:50.062295 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:50.062211    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" podUID="989e2bc5-363e-451f-8eb5-68fc40607d99" containerName="sequence-graph-8bebb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:01:55.062041 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:55.061999    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" podUID="989e2bc5-363e-451f-8eb5-68fc40607d99" containerName="sequence-graph-8bebb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:01:57.713912 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.713881    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"]
Jul 02 13:01:57.714297 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.714134    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" containerName="switch-graph-04e3b"
Jul 02 13:01:57.714297 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.714144    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" containerName="switch-graph-04e3b"
Jul 02 13:01:57.714297 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.714193    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8999b35d-3e41-4baa-928c-cdbeef1a73f5" containerName="switch-graph-04e3b"
Jul 02 13:01:57.718183 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.718165    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:01:57.724307 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.723917    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-c0346-serving-cert\""
Jul 02 13:01:57.724307 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.724038    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-c0346-kube-rbac-proxy-sar-config\""
Jul 02 13:01:57.733524 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.733497    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"]
Jul 02 13:01:57.818069 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.818037    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-openshift-service-ca-bundle\") pod \"ensemble-graph-c0346-6b7fdbb874-w6rwf\" (UID: \"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1\") " pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:01:57.818069 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.818075    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-proxy-tls\") pod \"ensemble-graph-c0346-6b7fdbb874-w6rwf\" (UID: \"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1\") " pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:01:57.919182 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.919148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-proxy-tls\") pod \"ensemble-graph-c0346-6b7fdbb874-w6rwf\" (UID: \"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1\") " pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:01:57.919374 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.919210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-openshift-service-ca-bundle\") pod \"ensemble-graph-c0346-6b7fdbb874-w6rwf\" (UID: \"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1\") " pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:01:57.919779 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.919757    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-openshift-service-ca-bundle\") pod \"ensemble-graph-c0346-6b7fdbb874-w6rwf\" (UID: \"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1\") " pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:01:57.921485 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:57.921464    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-proxy-tls\") pod \"ensemble-graph-c0346-6b7fdbb874-w6rwf\" (UID: \"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1\") " pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:01:58.027442 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:58.027346    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:01:58.151267 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:58.151243    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"]
Jul 02 13:01:58.153403 ip-10-0-128-177 kubenswrapper[2560]: W0702 13:01:58.153369    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdcc1ce2_39d9_48d5_a5e4_da21c88a84e1.slice/crio-50fa05efee8b85e6539c522a636321db5a80dd218e10856b887178cc6cf8ceea WatchSource:0}: Error finding container 50fa05efee8b85e6539c522a636321db5a80dd218e10856b887178cc6cf8ceea: Status 404 returned error can't find the container with id 50fa05efee8b85e6539c522a636321db5a80dd218e10856b887178cc6cf8ceea
Jul 02 13:01:58.896281 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:58.896246    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" event={"ID":"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1","Type":"ContainerStarted","Data":"6eeb057bc56a47d0902e983fbe5c5431d184e358e3e21beea1b557c24e4017d2"}
Jul 02 13:01:58.896728 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:58.896297    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" event={"ID":"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1","Type":"ContainerStarted","Data":"50fa05efee8b85e6539c522a636321db5a80dd218e10856b887178cc6cf8ceea"}
Jul 02 13:01:58.896728 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:58.896372    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:01:58.914647 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:01:58.914604    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" podStartSLOduration=1.914590765 podStartE2EDuration="1.914590765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:01:58.913031714 +0000 UTC m=+1389.645292133" watchObservedRunningTime="2026-07-02 13:01:58.914590765 +0000 UTC m=+1389.646851174"
Jul 02 13:02:00.061478 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:00.061426    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" podUID="989e2bc5-363e-451f-8eb5-68fc40607d99" containerName="sequence-graph-8bebb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:02:00.061855 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:00.061540    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 13:02:04.905616 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:04.905587    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:02:05.062374 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:05.062332    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" podUID="989e2bc5-363e-451f-8eb5-68fc40607d99" containerName="sequence-graph-8bebb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:02:07.791545 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:07.791463    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"]
Jul 02 13:02:07.791974 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:07.791675    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" podUID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" containerName="ensemble-graph-c0346" containerID="cri-o://6eeb057bc56a47d0902e983fbe5c5431d184e358e3e21beea1b557c24e4017d2" gracePeriod=30
Jul 02 13:02:09.904146 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:09.904104    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" podUID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" containerName="ensemble-graph-c0346" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:02:10.062098 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:10.062063    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" podUID="989e2bc5-363e-451f-8eb5-68fc40607d99" containerName="sequence-graph-8bebb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:02:14.904684 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:14.904638    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" podUID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" containerName="ensemble-graph-c0346" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:02:15.061708 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:15.061671    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" podUID="989e2bc5-363e-451f-8eb5-68fc40607d99" containerName="sequence-graph-8bebb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:02:17.672084 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.672060    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 13:02:17.768017 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.767985    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/989e2bc5-363e-451f-8eb5-68fc40607d99-proxy-tls\") pod \"989e2bc5-363e-451f-8eb5-68fc40607d99\" (UID: \"989e2bc5-363e-451f-8eb5-68fc40607d99\") "
Jul 02 13:02:17.768215 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.768051    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/989e2bc5-363e-451f-8eb5-68fc40607d99-openshift-service-ca-bundle\") pod \"989e2bc5-363e-451f-8eb5-68fc40607d99\" (UID: \"989e2bc5-363e-451f-8eb5-68fc40607d99\") "
Jul 02 13:02:17.768470 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.768416    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/989e2bc5-363e-451f-8eb5-68fc40607d99-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "989e2bc5-363e-451f-8eb5-68fc40607d99" (UID: "989e2bc5-363e-451f-8eb5-68fc40607d99"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 13:02:17.769978 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.769959    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/989e2bc5-363e-451f-8eb5-68fc40607d99-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "989e2bc5-363e-451f-8eb5-68fc40607d99" (UID: "989e2bc5-363e-451f-8eb5-68fc40607d99"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 13:02:17.869223 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.869192    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/989e2bc5-363e-451f-8eb5-68fc40607d99-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:02:17.869223 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.869219    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/989e2bc5-363e-451f-8eb5-68fc40607d99-openshift-service-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:02:17.965792 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.965762    2560 generic.go:356] "Generic (PLEG): container finished" podID="989e2bc5-363e-451f-8eb5-68fc40607d99" containerID="b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd" exitCode=0
Jul 02 13:02:17.965943 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.965861    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"
Jul 02 13:02:17.966014 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.965863    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" event={"ID":"989e2bc5-363e-451f-8eb5-68fc40607d99","Type":"ContainerDied","Data":"b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd"}
Jul 02 13:02:17.966078 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.966008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq" event={"ID":"989e2bc5-363e-451f-8eb5-68fc40607d99","Type":"ContainerDied","Data":"c311baf3dd960a97b8525846eecd3fbc94b38cd756b26e93a00ddf5b09e84904"}
Jul 02 13:02:17.966129 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.966049    2560 scope.go:117] "RemoveContainer" containerID="b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd"
Jul 02 13:02:17.974841 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.974826    2560 scope.go:117] "RemoveContainer" containerID="b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd"
Jul 02 13:02:17.975110 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:02:17.975089    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd\": container with ID starting with b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd not found: ID does not exist" containerID="b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd"
Jul 02 13:02:17.975165 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.975118    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd"} err="failed to get container status \"b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd\": rpc error: code = NotFound desc = could not find container \"b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd\": container with ID starting with b8cc6fa4b1434899ad2d51f50a6f997c6e438e60ad771adf14af0c6084c53dfd not found: ID does not exist"
Jul 02 13:02:17.989971 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.989951    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"]
Jul 02 13:02:17.996136 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:17.996116    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8bebb-86485cbd97-g4qmq"]
Jul 02 13:02:19.709616 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:19.706260    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="989e2bc5-363e-451f-8eb5-68fc40607d99" path="/var/lib/kubelet/pods/989e2bc5-363e-451f-8eb5-68fc40607d99/volumes"
Jul 02 13:02:19.904316 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:19.904282    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" podUID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" containerName="ensemble-graph-c0346" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:02:19.904513 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:19.904379    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:02:24.905048 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:24.905004    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" podUID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" containerName="ensemble-graph-c0346" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:02:29.904096 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:29.904053    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" podUID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" containerName="ensemble-graph-c0346" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:02:34.904279 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:34.904238    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" podUID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" containerName="ensemble-graph-c0346" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:02:38.039825 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:38.039792    2560 generic.go:356] "Generic (PLEG): container finished" podID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" containerID="6eeb057bc56a47d0902e983fbe5c5431d184e358e3e21beea1b557c24e4017d2" exitCode=0
Jul 02 13:02:38.040210 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:38.039866    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" event={"ID":"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1","Type":"ContainerDied","Data":"6eeb057bc56a47d0902e983fbe5c5431d184e358e3e21beea1b557c24e4017d2"}
Jul 02 13:02:38.429757 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:38.429735    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:02:38.515458 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:38.515395    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-openshift-service-ca-bundle\") pod \"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1\" (UID: \"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1\") "
Jul 02 13:02:38.515655 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:38.515488    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-proxy-tls\") pod \"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1\" (UID: \"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1\") "
Jul 02 13:02:38.515769 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:38.515744    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" (UID: "fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 13:02:38.517422 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:38.517398    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" (UID: "fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 13:02:38.616452 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:38.616398    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-openshift-service-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:02:38.616452 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:38.616457    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:02:39.044846 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:39.044765    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"
Jul 02 13:02:39.045299 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:39.044757    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf" event={"ID":"fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1","Type":"ContainerDied","Data":"50fa05efee8b85e6539c522a636321db5a80dd218e10856b887178cc6cf8ceea"}
Jul 02 13:02:39.045299 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:39.044901    2560 scope.go:117] "RemoveContainer" containerID="6eeb057bc56a47d0902e983fbe5c5431d184e358e3e21beea1b557c24e4017d2"
Jul 02 13:02:39.066541 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:39.066519    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"]
Jul 02 13:02:39.070218 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:39.070199    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c0346-6b7fdbb874-w6rwf"]
Jul 02 13:02:39.705812 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:39.705779    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" path="/var/lib/kubelet/pods/fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1/volumes"
Jul 02 13:02:57.709958 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.709926    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"]
Jul 02 13:02:57.710337 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.710188    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" containerName="ensemble-graph-c0346"
Jul 02 13:02:57.710337 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.710199    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" containerName="ensemble-graph-c0346"
Jul 02 13:02:57.710337 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.710208    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="989e2bc5-363e-451f-8eb5-68fc40607d99" containerName="sequence-graph-8bebb"
Jul 02 13:02:57.710337 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.710214    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="989e2bc5-363e-451f-8eb5-68fc40607d99" containerName="sequence-graph-8bebb"
Jul 02 13:02:57.710337 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.710263    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="989e2bc5-363e-451f-8eb5-68fc40607d99" containerName="sequence-graph-8bebb"
Jul 02 13:02:57.710337 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.710271    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdcc1ce2-39d9-48d5-a5e4-da21c88a84e1" containerName="ensemble-graph-c0346"
Jul 02 13:02:57.714295 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.714280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:02:57.716994 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.716964    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-7a990-kube-rbac-proxy-sar-config\""
Jul 02 13:02:57.716994 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.716980    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-7a990-serving-cert\""
Jul 02 13:02:57.717194 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.717138    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-p74sx\""
Jul 02 13:02:57.717260 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.717218    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 02 13:02:57.721314 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.721297    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"]
Jul 02 13:02:57.759912 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.759877    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-openshift-service-ca-bundle\") pod \"sequence-graph-7a990-795b58dd54-kbzhg\" (UID: \"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e\") " pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:02:57.760054 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.759949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-proxy-tls\") pod \"sequence-graph-7a990-795b58dd54-kbzhg\" (UID: \"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e\") " pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:02:57.860840 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.860805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-proxy-tls\") pod \"sequence-graph-7a990-795b58dd54-kbzhg\" (UID: \"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e\") " pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:02:57.861020 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.860861    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-openshift-service-ca-bundle\") pod \"sequence-graph-7a990-795b58dd54-kbzhg\" (UID: \"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e\") " pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:02:57.861020 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:02:57.860951    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-7a990-serving-cert: secret "sequence-graph-7a990-serving-cert" not found
Jul 02 13:02:57.861020 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:02:57.861016    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-proxy-tls podName:ba9f521e-a2c7-43b2-8f10-88d6fa89d21e nodeName:}" failed. No retries permitted until 2026-07-02 13:02:58.361000126 +0000 UTC m=+1449.093260513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-proxy-tls") pod "sequence-graph-7a990-795b58dd54-kbzhg" (UID: "ba9f521e-a2c7-43b2-8f10-88d6fa89d21e") : secret "sequence-graph-7a990-serving-cert" not found
Jul 02 13:02:57.861414 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:57.861397    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-openshift-service-ca-bundle\") pod \"sequence-graph-7a990-795b58dd54-kbzhg\" (UID: \"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e\") " pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:02:58.364716 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:58.364677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-proxy-tls\") pod \"sequence-graph-7a990-795b58dd54-kbzhg\" (UID: \"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e\") " pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:02:58.367018 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:58.366998    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-proxy-tls\") pod \"sequence-graph-7a990-795b58dd54-kbzhg\" (UID: \"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e\") " pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:02:58.624870 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:58.624791    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:02:58.749383 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:58.749359    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"]
Jul 02 13:02:58.751427 ip-10-0-128-177 kubenswrapper[2560]: W0702 13:02:58.751388    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9f521e_a2c7_43b2_8f10_88d6fa89d21e.slice/crio-7e70f0fdf769287ac0987500120f9b66cee5cb5b3fa12ed525b6217233271ba1 WatchSource:0}: Error finding container 7e70f0fdf769287ac0987500120f9b66cee5cb5b3fa12ed525b6217233271ba1: Status 404 returned error can't find the container with id 7e70f0fdf769287ac0987500120f9b66cee5cb5b3fa12ed525b6217233271ba1
Jul 02 13:02:59.115713 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:59.115679    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" event={"ID":"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e","Type":"ContainerStarted","Data":"17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62"}
Jul 02 13:02:59.115863 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:59.115729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" event={"ID":"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e","Type":"ContainerStarted","Data":"7e70f0fdf769287ac0987500120f9b66cee5cb5b3fa12ed525b6217233271ba1"}
Jul 02 13:02:59.115863 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:02:59.115780    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:03:05.124279 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:05.124242    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:03:05.142569 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:05.142520    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" podStartSLOduration=8.14250657 podStartE2EDuration="8.14250657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:02:59.140979922 +0000 UTC m=+1449.873240352" watchObservedRunningTime="2026-07-02 13:03:05.14250657 +0000 UTC m=+1455.874767016"
Jul 02 13:03:07.793144 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:07.793060    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"]
Jul 02 13:03:07.793928 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:07.793895    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" podUID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" containerName="sequence-graph-7a990" containerID="cri-o://17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62" gracePeriod=30
Jul 02 13:03:10.122913 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:10.122870    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" podUID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" containerName="sequence-graph-7a990" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:03:15.122878 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:15.122833    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" podUID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" containerName="sequence-graph-7a990" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:03:18.033784 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.033753    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"]
Jul 02 13:03:18.037202 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.037184    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:03:18.041534 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.041513    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-b2e72-serving-cert\""
Jul 02 13:03:18.041640 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.041546    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-b2e72-kube-rbac-proxy-sar-config\""
Jul 02 13:03:18.049629 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.049610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"]
Jul 02 13:03:18.133888 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.133851    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b785aef-0283-4aae-b551-320bf2e51374-openshift-service-ca-bundle\") pod \"ensemble-graph-b2e72-6778fd8957-k8n72\" (UID: \"3b785aef-0283-4aae-b551-320bf2e51374\") " pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:03:18.133888 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.133886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3b785aef-0283-4aae-b551-320bf2e51374-proxy-tls\") pod \"ensemble-graph-b2e72-6778fd8957-k8n72\" (UID: \"3b785aef-0283-4aae-b551-320bf2e51374\") " pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:03:18.234582 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.234548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b785aef-0283-4aae-b551-320bf2e51374-openshift-service-ca-bundle\") pod \"ensemble-graph-b2e72-6778fd8957-k8n72\" (UID: \"3b785aef-0283-4aae-b551-320bf2e51374\") " pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:03:18.234582 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.234586    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3b785aef-0283-4aae-b551-320bf2e51374-proxy-tls\") pod \"ensemble-graph-b2e72-6778fd8957-k8n72\" (UID: \"3b785aef-0283-4aae-b551-320bf2e51374\") " pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:03:18.234794 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:03:18.234729    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-b2e72-serving-cert: secret "ensemble-graph-b2e72-serving-cert" not found
Jul 02 13:03:18.234832 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:03:18.234808    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b785aef-0283-4aae-b551-320bf2e51374-proxy-tls podName:3b785aef-0283-4aae-b551-320bf2e51374 nodeName:}" failed. No retries permitted until 2026-07-02 13:03:18.734787041 +0000 UTC m=+1469.467047434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3b785aef-0283-4aae-b551-320bf2e51374-proxy-tls") pod "ensemble-graph-b2e72-6778fd8957-k8n72" (UID: "3b785aef-0283-4aae-b551-320bf2e51374") : secret "ensemble-graph-b2e72-serving-cert" not found
Jul 02 13:03:18.235281 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.235260    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b785aef-0283-4aae-b551-320bf2e51374-openshift-service-ca-bundle\") pod \"ensemble-graph-b2e72-6778fd8957-k8n72\" (UID: \"3b785aef-0283-4aae-b551-320bf2e51374\") " pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:03:18.739615 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.739578    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3b785aef-0283-4aae-b551-320bf2e51374-proxy-tls\") pod \"ensemble-graph-b2e72-6778fd8957-k8n72\" (UID: \"3b785aef-0283-4aae-b551-320bf2e51374\") " pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:03:18.741942 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.741924    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3b785aef-0283-4aae-b551-320bf2e51374-proxy-tls\") pod \"ensemble-graph-b2e72-6778fd8957-k8n72\" (UID: \"3b785aef-0283-4aae-b551-320bf2e51374\") " pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:03:18.946961 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:18.946930    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:03:19.067717 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:19.067695    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"]
Jul 02 13:03:19.069860 ip-10-0-128-177 kubenswrapper[2560]: W0702 13:03:19.069835    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b785aef_0283_4aae_b551_320bf2e51374.slice/crio-91570d536111a02231dc8a9c51d21daf42fa75d3ddfc5360d242b705b716275d WatchSource:0}: Error finding container 91570d536111a02231dc8a9c51d21daf42fa75d3ddfc5360d242b705b716275d: Status 404 returned error can't find the container with id 91570d536111a02231dc8a9c51d21daf42fa75d3ddfc5360d242b705b716275d
Jul 02 13:03:19.188983 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:19.188948    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" event={"ID":"3b785aef-0283-4aae-b551-320bf2e51374","Type":"ContainerStarted","Data":"f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe"}
Jul 02 13:03:19.189170 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:19.189002    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" event={"ID":"3b785aef-0283-4aae-b551-320bf2e51374","Type":"ContainerStarted","Data":"91570d536111a02231dc8a9c51d21daf42fa75d3ddfc5360d242b705b716275d"}
Jul 02 13:03:19.189170 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:19.189065    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:03:19.206705 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:19.206657    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" podStartSLOduration=1.206643713 podStartE2EDuration="1.206643713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:03:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:03:19.205204522 +0000 UTC m=+1469.937464942" watchObservedRunningTime="2026-07-02 13:03:19.206643713 +0000 UTC m=+1469.938904121"
Jul 02 13:03:20.122747 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:20.122709    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" podUID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" containerName="sequence-graph-7a990" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:03:20.123160 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:20.122801    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:03:25.122717 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:25.122665    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" podUID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" containerName="sequence-graph-7a990" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:03:25.198448 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:25.198411    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:03:30.122987 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:30.122947    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" podUID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" containerName="sequence-graph-7a990" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:03:35.122954 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:35.122916    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" podUID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" containerName="sequence-graph-7a990" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:03:37.937246 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:37.937221    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:03:37.975256 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:37.975232    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-proxy-tls\") pod \"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e\" (UID: \"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e\") "
Jul 02 13:03:37.975392 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:37.975279    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-openshift-service-ca-bundle\") pod \"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e\" (UID: \"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e\") "
Jul 02 13:03:37.975665 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:37.975640    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" (UID: "ba9f521e-a2c7-43b2-8f10-88d6fa89d21e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 13:03:37.977086 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:37.977064    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" (UID: "ba9f521e-a2c7-43b2-8f10-88d6fa89d21e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 13:03:38.076598 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:38.076514    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:03:38.076598 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:38.076545    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e-openshift-service-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:03:38.260031 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:38.259993    2560 generic.go:356] "Generic (PLEG): container finished" podID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" containerID="17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62" exitCode=0
Jul 02 13:03:38.260190 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:38.260040    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"
Jul 02 13:03:38.260190 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:38.260088    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" event={"ID":"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e","Type":"ContainerDied","Data":"17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62"}
Jul 02 13:03:38.260190 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:38.260143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg" event={"ID":"ba9f521e-a2c7-43b2-8f10-88d6fa89d21e","Type":"ContainerDied","Data":"7e70f0fdf769287ac0987500120f9b66cee5cb5b3fa12ed525b6217233271ba1"}
Jul 02 13:03:38.260190 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:38.260166    2560 scope.go:117] "RemoveContainer" containerID="17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62"
Jul 02 13:03:38.268777 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:38.268762    2560 scope.go:117] "RemoveContainer" containerID="17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62"
Jul 02 13:03:38.269091 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:03:38.269071    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62\": container with ID starting with 17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62 not found: ID does not exist" containerID="17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62"
Jul 02 13:03:38.269153 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:38.269103    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62"} err="failed to get container status \"17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62\": rpc error: code = NotFound desc = could not find container \"17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62\": container with ID starting with 17e12b631abc55e8ba021af87e005fea3ec37a23a83059bb5338b1e2933a9e62 not found: ID does not exist"
Jul 02 13:03:38.292129 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:38.292108    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"]
Jul 02 13:03:38.296666 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:38.296643    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-7a990-795b58dd54-kbzhg"]
Jul 02 13:03:39.706915 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:39.706882    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" path="/var/lib/kubelet/pods/ba9f521e-a2c7-43b2-8f10-88d6fa89d21e/volumes"
Jul 02 13:03:49.747343 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:49.747315    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:03:49.751671 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:03:49.751652    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:04:08.023233 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.023193    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"]
Jul 02 13:04:08.023782 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.023622    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" containerName="sequence-graph-7a990"
Jul 02 13:04:08.023782 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.023639    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" containerName="sequence-graph-7a990"
Jul 02 13:04:08.023782 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.023730    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9f521e-a2c7-43b2-8f10-88d6fa89d21e" containerName="sequence-graph-7a990"
Jul 02 13:04:08.027715 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.027693    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:04:08.030757 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.030739    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-5b6c7-serving-cert\""
Jul 02 13:04:08.031100 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.031086    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-5b6c7-kube-rbac-proxy-sar-config\""
Jul 02 13:04:08.036108 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.036083    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"]
Jul 02 13:04:08.099412 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.099380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6ec7311f-0da4-4296-babf-b00cb78cea17-proxy-tls\") pod \"sequence-graph-5b6c7-7bcb5cf8c8-zvl47\" (UID: \"6ec7311f-0da4-4296-babf-b00cb78cea17\") " pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:04:08.099563 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.099455    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ec7311f-0da4-4296-babf-b00cb78cea17-openshift-service-ca-bundle\") pod \"sequence-graph-5b6c7-7bcb5cf8c8-zvl47\" (UID: \"6ec7311f-0da4-4296-babf-b00cb78cea17\") " pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:04:08.200342 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.200309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6ec7311f-0da4-4296-babf-b00cb78cea17-proxy-tls\") pod \"sequence-graph-5b6c7-7bcb5cf8c8-zvl47\" (UID: \"6ec7311f-0da4-4296-babf-b00cb78cea17\") " pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:04:08.200496 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.200360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ec7311f-0da4-4296-babf-b00cb78cea17-openshift-service-ca-bundle\") pod \"sequence-graph-5b6c7-7bcb5cf8c8-zvl47\" (UID: \"6ec7311f-0da4-4296-babf-b00cb78cea17\") " pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:04:08.200496 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:04:08.200475    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-5b6c7-serving-cert: secret "sequence-graph-5b6c7-serving-cert" not found
Jul 02 13:04:08.200569 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:04:08.200540    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec7311f-0da4-4296-babf-b00cb78cea17-proxy-tls podName:6ec7311f-0da4-4296-babf-b00cb78cea17 nodeName:}" failed. No retries permitted until 2026-07-02 13:04:08.700524744 +0000 UTC m=+1519.432785131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/6ec7311f-0da4-4296-babf-b00cb78cea17-proxy-tls") pod "sequence-graph-5b6c7-7bcb5cf8c8-zvl47" (UID: "6ec7311f-0da4-4296-babf-b00cb78cea17") : secret "sequence-graph-5b6c7-serving-cert" not found
Jul 02 13:04:08.200978 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.200959    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ec7311f-0da4-4296-babf-b00cb78cea17-openshift-service-ca-bundle\") pod \"sequence-graph-5b6c7-7bcb5cf8c8-zvl47\" (UID: \"6ec7311f-0da4-4296-babf-b00cb78cea17\") " pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:04:08.705698 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.705659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6ec7311f-0da4-4296-babf-b00cb78cea17-proxy-tls\") pod \"sequence-graph-5b6c7-7bcb5cf8c8-zvl47\" (UID: \"6ec7311f-0da4-4296-babf-b00cb78cea17\") " pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:04:08.707962 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.707942    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6ec7311f-0da4-4296-babf-b00cb78cea17-proxy-tls\") pod \"sequence-graph-5b6c7-7bcb5cf8c8-zvl47\" (UID: \"6ec7311f-0da4-4296-babf-b00cb78cea17\") " pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:04:08.937859 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:08.937823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:04:09.064123 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:09.064001    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"]
Jul 02 13:04:09.066779 ip-10-0-128-177 kubenswrapper[2560]: W0702 13:04:09.066752    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec7311f_0da4_4296_babf_b00cb78cea17.slice/crio-9efdcf4f6c5b66961bb3aa0d1f5466e449ae0c9d9cc0e8b1e706b0dde2e677f7 WatchSource:0}: Error finding container 9efdcf4f6c5b66961bb3aa0d1f5466e449ae0c9d9cc0e8b1e706b0dde2e677f7: Status 404 returned error can't find the container with id 9efdcf4f6c5b66961bb3aa0d1f5466e449ae0c9d9cc0e8b1e706b0dde2e677f7
Jul 02 13:04:09.374394 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:09.374361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" event={"ID":"6ec7311f-0da4-4296-babf-b00cb78cea17","Type":"ContainerStarted","Data":"a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d"}
Jul 02 13:04:09.374690 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:09.374414    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" event={"ID":"6ec7311f-0da4-4296-babf-b00cb78cea17","Type":"ContainerStarted","Data":"9efdcf4f6c5b66961bb3aa0d1f5466e449ae0c9d9cc0e8b1e706b0dde2e677f7"}
Jul 02 13:04:09.374690 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:09.374468    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:04:09.392003 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:09.391958    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" podStartSLOduration=1.391942885 podStartE2EDuration="1.391942885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:04:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:04:09.391084119 +0000 UTC m=+1520.123344529" watchObservedRunningTime="2026-07-02 13:04:09.391942885 +0000 UTC m=+1520.124203293"
Jul 02 13:04:15.384128 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:04:15.384039    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:08:49.771987 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:08:49.771959    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:08:49.776569 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:08:49.776550    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:11:32.767384 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:11:32.767351    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"]
Jul 02 13:11:32.767898 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:11:32.767614    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" podUID="3b785aef-0283-4aae-b551-320bf2e51374" containerName="ensemble-graph-b2e72" containerID="cri-o://f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe" gracePeriod=30
Jul 02 13:11:35.197173 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:11:35.197133    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" podUID="3b785aef-0283-4aae-b551-320bf2e51374" containerName="ensemble-graph-b2e72" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:11:40.197648 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:11:40.197610    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" podUID="3b785aef-0283-4aae-b551-320bf2e51374" containerName="ensemble-graph-b2e72" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:11:45.196774 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:11:45.196739    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" podUID="3b785aef-0283-4aae-b551-320bf2e51374" containerName="ensemble-graph-b2e72" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:11:45.197165 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:11:45.196848    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:11:50.197287 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:11:50.197250    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" podUID="3b785aef-0283-4aae-b551-320bf2e51374" containerName="ensemble-graph-b2e72" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:11:55.197573 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:11:55.197530    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" podUID="3b785aef-0283-4aae-b551-320bf2e51374" containerName="ensemble-graph-b2e72" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:12:00.196733 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:00.196695    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" podUID="3b785aef-0283-4aae-b551-320bf2e51374" containerName="ensemble-graph-b2e72" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:12:02.911685 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:02.911661    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:12:02.995208 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:02.995176    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b785aef-0283-4aae-b551-320bf2e51374-openshift-service-ca-bundle\") pod \"3b785aef-0283-4aae-b551-320bf2e51374\" (UID: \"3b785aef-0283-4aae-b551-320bf2e51374\") "
Jul 02 13:12:02.995383 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:02.995221    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3b785aef-0283-4aae-b551-320bf2e51374-proxy-tls\") pod \"3b785aef-0283-4aae-b551-320bf2e51374\" (UID: \"3b785aef-0283-4aae-b551-320bf2e51374\") "
Jul 02 13:12:02.995562 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:02.995537    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b785aef-0283-4aae-b551-320bf2e51374-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "3b785aef-0283-4aae-b551-320bf2e51374" (UID: "3b785aef-0283-4aae-b551-320bf2e51374"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 13:12:02.997415 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:02.997380    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b785aef-0283-4aae-b551-320bf2e51374-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3b785aef-0283-4aae-b551-320bf2e51374" (UID: "3b785aef-0283-4aae-b551-320bf2e51374"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 13:12:03.055325 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.055248    2560 generic.go:356] "Generic (PLEG): container finished" podID="3b785aef-0283-4aae-b551-320bf2e51374" containerID="f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe" exitCode=0
Jul 02 13:12:03.055325 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.055296    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"
Jul 02 13:12:03.055325 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.055313    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" event={"ID":"3b785aef-0283-4aae-b551-320bf2e51374","Type":"ContainerDied","Data":"f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe"}
Jul 02 13:12:03.055571 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.055356    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72" event={"ID":"3b785aef-0283-4aae-b551-320bf2e51374","Type":"ContainerDied","Data":"91570d536111a02231dc8a9c51d21daf42fa75d3ddfc5360d242b705b716275d"}
Jul 02 13:12:03.055571 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.055376    2560 scope.go:117] "RemoveContainer" containerID="f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe"
Jul 02 13:12:03.068354 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.068333    2560 scope.go:117] "RemoveContainer" containerID="f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe"
Jul 02 13:12:03.068641 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:12:03.068625    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe\": container with ID starting with f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe not found: ID does not exist" containerID="f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe"
Jul 02 13:12:03.068703 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.068647    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe"} err="failed to get container status \"f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe\": rpc error: code = NotFound desc = could not find container \"f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe\": container with ID starting with f8b4ec48308ee8347a8c3b49e0b57625f29a48a99df9752161c262b1e0438efe not found: ID does not exist"
Jul 02 13:12:03.095268 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.095240    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"]
Jul 02 13:12:03.096183 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.096161    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3b785aef-0283-4aae-b551-320bf2e51374-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:12:03.096183 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.096182    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b785aef-0283-4aae-b551-320bf2e51374-openshift-service-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:12:03.129357 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.129330    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-b2e72-6778fd8957-k8n72"]
Jul 02 13:12:03.705401 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:03.705368    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b785aef-0283-4aae-b551-320bf2e51374" path="/var/lib/kubelet/pods/3b785aef-0283-4aae-b551-320bf2e51374/volumes"
Jul 02 13:12:22.736538 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:22.736508    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"]
Jul 02 13:12:22.736916 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:22.736688    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" podUID="6ec7311f-0da4-4296-babf-b00cb78cea17" containerName="sequence-graph-5b6c7" containerID="cri-o://a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d" gracePeriod=30
Jul 02 13:12:25.382973 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:25.382936    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" podUID="6ec7311f-0da4-4296-babf-b00cb78cea17" containerName="sequence-graph-5b6c7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:12:30.382361 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:30.382326    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" podUID="6ec7311f-0da4-4296-babf-b00cb78cea17" containerName="sequence-graph-5b6c7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:12:32.992223 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:32.992184    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"]
Jul 02 13:12:32.992720 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:32.992615    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b785aef-0283-4aae-b551-320bf2e51374" containerName="ensemble-graph-b2e72"
Jul 02 13:12:32.992720 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:32.992633    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b785aef-0283-4aae-b551-320bf2e51374" containerName="ensemble-graph-b2e72"
Jul 02 13:12:32.992720 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:32.992706    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b785aef-0283-4aae-b551-320bf2e51374" containerName="ensemble-graph-b2e72"
Jul 02 13:12:32.995622 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:32.995602    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:12:32.998208 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:32.998183    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-63f60-serving-cert\""
Jul 02 13:12:32.998288 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:32.998185    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-63f60-kube-rbac-proxy-sar-config\""
Jul 02 13:12:33.004137 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:33.004114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"]
Jul 02 13:12:33.129400 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:33.129350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-openshift-service-ca-bundle\") pod \"splitter-graph-63f60-76d54bfbbb-bdcgl\" (UID: \"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d\") " pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:12:33.129400 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:33.129406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-proxy-tls\") pod \"splitter-graph-63f60-76d54bfbbb-bdcgl\" (UID: \"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d\") " pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:12:33.230603 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:33.230567    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-openshift-service-ca-bundle\") pod \"splitter-graph-63f60-76d54bfbbb-bdcgl\" (UID: \"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d\") " pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:12:33.230603 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:33.230605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-proxy-tls\") pod \"splitter-graph-63f60-76d54bfbbb-bdcgl\" (UID: \"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d\") " pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:12:33.231253 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:33.231223    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-openshift-service-ca-bundle\") pod \"splitter-graph-63f60-76d54bfbbb-bdcgl\" (UID: \"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d\") " pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:12:33.232902 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:33.232878    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-proxy-tls\") pod \"splitter-graph-63f60-76d54bfbbb-bdcgl\" (UID: \"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d\") " pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:12:33.305998 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:33.305919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:12:33.430423 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:33.430400    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"]
Jul 02 13:12:33.432984 ip-10-0-128-177 kubenswrapper[2560]: W0702 13:12:33.432957    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d4ff50_0fb6_46f3_b3ac_eb78aff9536d.slice/crio-9b58edc48c94500a51a682db0921a06c6391136db3b5737147647de48ff19499 WatchSource:0}: Error finding container 9b58edc48c94500a51a682db0921a06c6391136db3b5737147647de48ff19499: Status 404 returned error can't find the container with id 9b58edc48c94500a51a682db0921a06c6391136db3b5737147647de48ff19499
Jul 02 13:12:34.170643 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:34.170604    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" event={"ID":"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d","Type":"ContainerStarted","Data":"2cdbc63dc560bdfba2d8bdacfb30112af445beecb9cbd1dead2680bd72c01d23"}
Jul 02 13:12:34.171030 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:34.170659    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" event={"ID":"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d","Type":"ContainerStarted","Data":"9b58edc48c94500a51a682db0921a06c6391136db3b5737147647de48ff19499"}
Jul 02 13:12:34.171030 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:34.170740    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:12:34.188892 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:34.188840    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" podStartSLOduration=2.188825406 podStartE2EDuration="2.188825406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:12:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:12:34.187858199 +0000 UTC m=+2024.920118608" watchObservedRunningTime="2026-07-02 13:12:34.188825406 +0000 UTC m=+2024.921085867"
Jul 02 13:12:35.382149 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:35.382111    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" podUID="6ec7311f-0da4-4296-babf-b00cb78cea17" containerName="sequence-graph-5b6c7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:12:35.382705 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:35.382220    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:12:40.180139 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:40.180110    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:12:40.382033 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:40.381995    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" podUID="6ec7311f-0da4-4296-babf-b00cb78cea17" containerName="sequence-graph-5b6c7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:12:43.198474 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:43.198445    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"]
Jul 02 13:12:43.198896 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:43.198634    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" podUID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" containerName="splitter-graph-63f60" containerID="cri-o://2cdbc63dc560bdfba2d8bdacfb30112af445beecb9cbd1dead2680bd72c01d23" gracePeriod=30
Jul 02 13:12:45.178681 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:45.178636    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" podUID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" containerName="splitter-graph-63f60" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:12:45.382355 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:45.382318    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" podUID="6ec7311f-0da4-4296-babf-b00cb78cea17" containerName="sequence-graph-5b6c7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:12:50.178694 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:50.178605    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" podUID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" containerName="splitter-graph-63f60" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:12:50.382785 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:50.382749    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" podUID="6ec7311f-0da4-4296-babf-b00cb78cea17" containerName="sequence-graph-5b6c7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:12:52.881287 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:52.881262    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:12:52.988556 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:52.988521    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ec7311f-0da4-4296-babf-b00cb78cea17-openshift-service-ca-bundle\") pod \"6ec7311f-0da4-4296-babf-b00cb78cea17\" (UID: \"6ec7311f-0da4-4296-babf-b00cb78cea17\") "
Jul 02 13:12:52.988556 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:52.988564    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6ec7311f-0da4-4296-babf-b00cb78cea17-proxy-tls\") pod \"6ec7311f-0da4-4296-babf-b00cb78cea17\" (UID: \"6ec7311f-0da4-4296-babf-b00cb78cea17\") "
Jul 02 13:12:52.988984 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:52.988945    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ec7311f-0da4-4296-babf-b00cb78cea17-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6ec7311f-0da4-4296-babf-b00cb78cea17" (UID: "6ec7311f-0da4-4296-babf-b00cb78cea17"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 13:12:52.990728 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:52.990663    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ec7311f-0da4-4296-babf-b00cb78cea17-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6ec7311f-0da4-4296-babf-b00cb78cea17" (UID: "6ec7311f-0da4-4296-babf-b00cb78cea17"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 13:12:53.089621 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.089589    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6ec7311f-0da4-4296-babf-b00cb78cea17-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:12:53.089621 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.089613    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ec7311f-0da4-4296-babf-b00cb78cea17-openshift-service-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:12:53.244389 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.244300    2560 generic.go:356] "Generic (PLEG): container finished" podID="6ec7311f-0da4-4296-babf-b00cb78cea17" containerID="a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d" exitCode=0
Jul 02 13:12:53.244389 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.244349    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"
Jul 02 13:12:53.244389 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.244357    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" event={"ID":"6ec7311f-0da4-4296-babf-b00cb78cea17","Type":"ContainerDied","Data":"a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d"}
Jul 02 13:12:53.244656 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.244409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47" event={"ID":"6ec7311f-0da4-4296-babf-b00cb78cea17","Type":"ContainerDied","Data":"9efdcf4f6c5b66961bb3aa0d1f5466e449ae0c9d9cc0e8b1e706b0dde2e677f7"}
Jul 02 13:12:53.244656 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.244457    2560 scope.go:117] "RemoveContainer" containerID="a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d"
Jul 02 13:12:53.253570 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.253541    2560 scope.go:117] "RemoveContainer" containerID="a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d"
Jul 02 13:12:53.253824 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:12:53.253799    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d\": container with ID starting with a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d not found: ID does not exist" containerID="a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d"
Jul 02 13:12:53.253918 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.253834    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d"} err="failed to get container status \"a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d\": rpc error: code = NotFound desc = could not find container \"a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d\": container with ID starting with a9074d7061147052ae0281b0cf1296631ad8179e3f27496e20add5a10c97c34d not found: ID does not exist"
Jul 02 13:12:53.271737 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.271712    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"]
Jul 02 13:12:53.280942 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.280918    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5b6c7-7bcb5cf8c8-zvl47"]
Jul 02 13:12:53.705144 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:53.705107    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ec7311f-0da4-4296-babf-b00cb78cea17" path="/var/lib/kubelet/pods/6ec7311f-0da4-4296-babf-b00cb78cea17/volumes"
Jul 02 13:12:55.179404 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:55.179363    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" podUID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" containerName="splitter-graph-63f60" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:12:55.179813 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:12:55.179490    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:13:00.178741 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:00.178700    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" podUID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" containerName="splitter-graph-63f60" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:13:05.179082 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:05.179040    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" podUID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" containerName="splitter-graph-63f60" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:13:10.178787 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:10.178737    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" podUID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" containerName="splitter-graph-63f60" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:13:13.319394 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:13.319356    2560 generic.go:356] "Generic (PLEG): container finished" podID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" containerID="2cdbc63dc560bdfba2d8bdacfb30112af445beecb9cbd1dead2680bd72c01d23" exitCode=0
Jul 02 13:13:13.319832 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:13.319392    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" event={"ID":"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d","Type":"ContainerDied","Data":"2cdbc63dc560bdfba2d8bdacfb30112af445beecb9cbd1dead2680bd72c01d23"}
Jul 02 13:13:13.844774 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:13.844749    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:13:13.853888 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:13.853864    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-openshift-service-ca-bundle\") pod \"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d\" (UID: \"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d\") "
Jul 02 13:13:13.854004 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:13.853923    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-proxy-tls\") pod \"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d\" (UID: \"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d\") "
Jul 02 13:13:13.854190 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:13.854168    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" (UID: "a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 13:13:13.855950 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:13.855927    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" (UID: "a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 13:13:13.954405 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:13.954365    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:13:13.954405 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:13.954396    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d-openshift-service-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:13:14.328817 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:14.328774    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl" event={"ID":"a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d","Type":"ContainerDied","Data":"9b58edc48c94500a51a682db0921a06c6391136db3b5737147647de48ff19499"}
Jul 02 13:13:14.328817 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:14.328801    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"
Jul 02 13:13:14.329345 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:14.328875    2560 scope.go:117] "RemoveContainer" containerID="2cdbc63dc560bdfba2d8bdacfb30112af445beecb9cbd1dead2680bd72c01d23"
Jul 02 13:13:14.349026 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:14.349001    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"]
Jul 02 13:13:14.352574 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:14.352550    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-63f60-76d54bfbbb-bdcgl"]
Jul 02 13:13:15.705212 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:15.705179    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" path="/var/lib/kubelet/pods/a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d/volumes"
Jul 02 13:13:33.113877 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.113839    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"]
Jul 02 13:13:33.114258 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.114099    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" containerName="splitter-graph-63f60"
Jul 02 13:13:33.114258 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.114110    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" containerName="splitter-graph-63f60"
Jul 02 13:13:33.114258 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.114131    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec7311f-0da4-4296-babf-b00cb78cea17" containerName="sequence-graph-5b6c7"
Jul 02 13:13:33.114258 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.114136    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec7311f-0da4-4296-babf-b00cb78cea17" containerName="sequence-graph-5b6c7"
Jul 02 13:13:33.114258 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.114176    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec7311f-0da4-4296-babf-b00cb78cea17" containerName="sequence-graph-5b6c7"
Jul 02 13:13:33.114258 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.114185    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3d4ff50-0fb6-46f3-b3ac-eb78aff9536d" containerName="splitter-graph-63f60"
Jul 02 13:13:33.116869 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.116853    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:13:33.134769 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.134749    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-p74sx\""
Jul 02 13:13:33.135041 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.135024    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-f7674-kube-rbac-proxy-sar-config\""
Jul 02 13:13:33.136861 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.136846    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-f7674-serving-cert\""
Jul 02 13:13:33.140577 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.140559    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 02 13:13:33.156374 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.156352    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"]
Jul 02 13:13:33.200894 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.200867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-proxy-tls\") pod \"switch-graph-f7674-7d596db84c-9969j\" (UID: \"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f\") " pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:13:33.200994 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.200910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-openshift-service-ca-bundle\") pod \"switch-graph-f7674-7d596db84c-9969j\" (UID: \"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f\") " pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:13:33.302055 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.302016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-proxy-tls\") pod \"switch-graph-f7674-7d596db84c-9969j\" (UID: \"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f\") " pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:13:33.302226 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.302078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-openshift-service-ca-bundle\") pod \"switch-graph-f7674-7d596db84c-9969j\" (UID: \"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f\") " pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:13:33.302699 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.302672    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-openshift-service-ca-bundle\") pod \"switch-graph-f7674-7d596db84c-9969j\" (UID: \"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f\") " pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:13:33.304420 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.304402    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-proxy-tls\") pod \"switch-graph-f7674-7d596db84c-9969j\" (UID: \"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f\") " pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:13:33.425970 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.425876    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:13:33.573394 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:33.573278    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"]
Jul 02 13:13:33.575834 ip-10-0-128-177 kubenswrapper[2560]: W0702 13:13:33.575811    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef42e84_c1c9_4b05_bc8d_9403af30bf3f.slice/crio-1f50fedc70d4d67a165db3b63f9cfa9b2e70d392bd77e2dd2f59aadf8cce6881 WatchSource:0}: Error finding container 1f50fedc70d4d67a165db3b63f9cfa9b2e70d392bd77e2dd2f59aadf8cce6881: Status 404 returned error can't find the container with id 1f50fedc70d4d67a165db3b63f9cfa9b2e70d392bd77e2dd2f59aadf8cce6881
Jul 02 13:13:34.400105 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:34.400066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" event={"ID":"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f","Type":"ContainerStarted","Data":"726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656"}
Jul 02 13:13:34.400591 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:34.400118    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" event={"ID":"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f","Type":"ContainerStarted","Data":"1f50fedc70d4d67a165db3b63f9cfa9b2e70d392bd77e2dd2f59aadf8cce6881"}
Jul 02 13:13:34.400591 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:34.400234    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:13:34.450198 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:34.450145    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" podStartSLOduration=1.4501295889999999 podStartE2EDuration="1.450129589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:13:34.449267916 +0000 UTC m=+2085.181528327" watchObservedRunningTime="2026-07-02 13:13:34.450129589 +0000 UTC m=+2085.182389997"
Jul 02 13:13:40.409793 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:40.409761    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:13:43.481311 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.481278    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"]
Jul 02 13:13:43.484716 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.484699    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:13:43.489365 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.489340    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-99760-kube-rbac-proxy-sar-config\""
Jul 02 13:13:43.489612 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.489590    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-99760-serving-cert\""
Jul 02 13:13:43.505071 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.505046    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"]
Jul 02 13:13:43.584319 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.584287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-openshift-service-ca-bundle\") pod \"splitter-graph-99760-7486b86459-ktkmd\" (UID: \"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60\") " pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:13:43.584539 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.584362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-proxy-tls\") pod \"splitter-graph-99760-7486b86459-ktkmd\" (UID: \"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60\") " pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:13:43.684986 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.684947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-proxy-tls\") pod \"splitter-graph-99760-7486b86459-ktkmd\" (UID: \"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60\") " pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:13:43.685146 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.685014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-openshift-service-ca-bundle\") pod \"splitter-graph-99760-7486b86459-ktkmd\" (UID: \"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60\") " pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:13:43.685727 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.685709    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-openshift-service-ca-bundle\") pod \"splitter-graph-99760-7486b86459-ktkmd\" (UID: \"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60\") " pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:13:43.687483 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.687456    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-proxy-tls\") pod \"splitter-graph-99760-7486b86459-ktkmd\" (UID: \"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60\") " pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:13:43.794138 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.794045    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:13:43.931215 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:43.931165    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"]
Jul 02 13:13:43.933619 ip-10-0-128-177 kubenswrapper[2560]: W0702 13:13:43.933597    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67dd30f_da2a_4489_bb0e_df1d9d8c0f60.slice/crio-9c21584f3b4bfd30c01d61d9db591c99384c335690d7b1766efe9cf5bebd2740 WatchSource:0}: Error finding container 9c21584f3b4bfd30c01d61d9db591c99384c335690d7b1766efe9cf5bebd2740: Status 404 returned error can't find the container with id 9c21584f3b4bfd30c01d61d9db591c99384c335690d7b1766efe9cf5bebd2740
Jul 02 13:13:44.437735 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:44.437695    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" event={"ID":"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60","Type":"ContainerStarted","Data":"bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5"}
Jul 02 13:13:44.437890 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:44.437757    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" event={"ID":"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60","Type":"ContainerStarted","Data":"9c21584f3b4bfd30c01d61d9db591c99384c335690d7b1766efe9cf5bebd2740"}
Jul 02 13:13:44.437890 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:44.437794    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:13:44.470476 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:44.470401    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" podStartSLOduration=1.470384669 podStartE2EDuration="1.470384669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:13:44.470219511 +0000 UTC m=+2095.202479920" watchObservedRunningTime="2026-07-02 13:13:44.470384669 +0000 UTC m=+2095.202645078"
Jul 02 13:13:49.793856 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:49.793830    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:13:49.797933 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:49.797914    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:13:50.447346 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:13:50.447319    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:18:49.815300 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:18:49.815193    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:18:49.819629 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:18:49.819597    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:21:58.040839 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:21:58.040810    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"]
Jul 02 13:21:58.041344 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:21:58.041007    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" podUID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" containerName="splitter-graph-99760" containerID="cri-o://bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5" gracePeriod=30
Jul 02 13:22:00.445564 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:00.445528    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" podUID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" containerName="splitter-graph-99760" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:22:05.445769 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:05.445735    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" podUID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" containerName="splitter-graph-99760" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:22:10.444808 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:10.444769    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" podUID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" containerName="splitter-graph-99760" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:22:10.445154 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:10.444898    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:22:15.445328 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:15.445245    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" podUID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" containerName="splitter-graph-99760" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:22:20.444719 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:20.444679    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" podUID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" containerName="splitter-graph-99760" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:22:25.445079 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:25.445044    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" podUID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" containerName="splitter-graph-99760" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:22:28.179551 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.179526    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:22:28.237808 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.237785    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-openshift-service-ca-bundle\") pod \"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60\" (UID: \"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60\") "
Jul 02 13:22:28.237909 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.237819    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-proxy-tls\") pod \"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60\" (UID: \"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60\") "
Jul 02 13:22:28.238136 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.238116    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" (UID: "f67dd30f-da2a-4489-bb0e-df1d9d8c0f60"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 13:22:28.239886 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.239867    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" (UID: "f67dd30f-da2a-4489-bb0e-df1d9d8c0f60"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 13:22:28.316359 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.316290    2560 generic.go:356] "Generic (PLEG): container finished" podID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" containerID="bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5" exitCode=137
Jul 02 13:22:28.316359 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.316335    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"
Jul 02 13:22:28.316359 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.316342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" event={"ID":"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60","Type":"ContainerDied","Data":"bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5"}
Jul 02 13:22:28.316602 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.316390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd" event={"ID":"f67dd30f-da2a-4489-bb0e-df1d9d8c0f60","Type":"ContainerDied","Data":"9c21584f3b4bfd30c01d61d9db591c99384c335690d7b1766efe9cf5bebd2740"}
Jul 02 13:22:28.316602 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.316419    2560 scope.go:117] "RemoveContainer" containerID="bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5"
Jul 02 13:22:28.324312 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.324295    2560 scope.go:117] "RemoveContainer" containerID="bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5"
Jul 02 13:22:28.324568 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:22:28.324550    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5\": container with ID starting with bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5 not found: ID does not exist" containerID="bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5"
Jul 02 13:22:28.324645 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.324576    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5"} err="failed to get container status \"bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5\": rpc error: code = NotFound desc = could not find container \"bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5\": container with ID starting with bc7d6e1d4694f4a2a6d0d1bee5be2da5c9e915016a8c210199bf4a28ea6377a5 not found: ID does not exist"
Jul 02 13:22:28.337955 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.337935    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"]
Jul 02 13:22:28.338952 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.338936    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-openshift-service-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:22:28.338998 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.338957    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:22:28.342048 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:28.342030    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-99760-7486b86459-ktkmd"]
Jul 02 13:22:29.705941 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:22:29.705913    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" path="/var/lib/kubelet/pods/f67dd30f-da2a-4489-bb0e-df1d9d8c0f60/volumes"
Jul 02 13:23:49.835590 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:23:49.835568    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:23:49.840987 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:23:49.840964    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:28:49.860748 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:28:49.860648    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:28:49.867670 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:28:49.867650    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:29:52.182555 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:52.182520    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"]
Jul 02 13:29:52.183057 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:52.182700    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" podUID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" containerName="switch-graph-f7674" containerID="cri-o://726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656" gracePeriod=30
Jul 02 13:29:53.586107 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.586078    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vlldq/must-gather-4rqr9"]
Jul 02 13:29:53.586462 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.586347    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" containerName="splitter-graph-99760"
Jul 02 13:29:53.586462 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.586359    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" containerName="splitter-graph-99760"
Jul 02 13:29:53.586462 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.586405    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f67dd30f-da2a-4489-bb0e-df1d9d8c0f60" containerName="splitter-graph-99760"
Jul 02 13:29:53.589355 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.589340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vlldq/must-gather-4rqr9"
Jul 02 13:29:53.591835 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.591814    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vlldq\"/\"default-dockercfg-hffs8\""
Jul 02 13:29:53.592760 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.592745    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vlldq\"/\"openshift-service-ca.crt\""
Jul 02 13:29:53.593185 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.593171    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vlldq\"/\"kube-root-ca.crt\""
Jul 02 13:29:53.597750 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.597728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vlldq/must-gather-4rqr9"]
Jul 02 13:29:53.674624 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.674604    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-must-gather-output\") pod \"must-gather-4rqr9\" (UID: \"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492\") " pod="openshift-must-gather-vlldq/must-gather-4rqr9"
Jul 02 13:29:53.674721 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.674640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzbpg\" (UniqueName: \"kubernetes.io/projected/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-kube-api-access-bzbpg\") pod \"must-gather-4rqr9\" (UID: \"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492\") " pod="openshift-must-gather-vlldq/must-gather-4rqr9"
Jul 02 13:29:53.775606 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.775579    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbpg\" (UniqueName: \"kubernetes.io/projected/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-kube-api-access-bzbpg\") pod \"must-gather-4rqr9\" (UID: \"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492\") " pod="openshift-must-gather-vlldq/must-gather-4rqr9"
Jul 02 13:29:53.775728 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.775711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-must-gather-output\") pod \"must-gather-4rqr9\" (UID: \"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492\") " pod="openshift-must-gather-vlldq/must-gather-4rqr9"
Jul 02 13:29:53.776112 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.776092    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-must-gather-output\") pod \"must-gather-4rqr9\" (UID: \"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492\") " pod="openshift-must-gather-vlldq/must-gather-4rqr9"
Jul 02 13:29:53.784427 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.784408    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzbpg\" (UniqueName: \"kubernetes.io/projected/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-kube-api-access-bzbpg\") pod \"must-gather-4rqr9\" (UID: \"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492\") " pod="openshift-must-gather-vlldq/must-gather-4rqr9"
Jul 02 13:29:53.917126 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:53.917075    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vlldq/must-gather-4rqr9"
Jul 02 13:29:54.044353 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:54.044313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vlldq/must-gather-4rqr9"]
Jul 02 13:29:54.046660 ip-10-0-128-177 kubenswrapper[2560]: W0702 13:29:54.046634    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52f6c18a_b84f_4672_8ebd_6dd4e5d6f492.slice/crio-db925361c98405f99738309636bf7648bf1df8d5daa5945f691299393c94f7e3 WatchSource:0}: Error finding container db925361c98405f99738309636bf7648bf1df8d5daa5945f691299393c94f7e3: Status 404 returned error can't find the container with id db925361c98405f99738309636bf7648bf1df8d5daa5945f691299393c94f7e3
Jul 02 13:29:54.048779 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:54.048765    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 13:29:54.829822 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:54.829784    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vlldq/must-gather-4rqr9" event={"ID":"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492","Type":"ContainerStarted","Data":"db925361c98405f99738309636bf7648bf1df8d5daa5945f691299393c94f7e3"}
Jul 02 13:29:55.409122 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:29:55.409067    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" podUID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" containerName="switch-graph-f7674" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:30:00.409857 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:00.409802    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" podUID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" containerName="switch-graph-f7674" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:30:00.856828 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:00.856794    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vlldq/must-gather-4rqr9" event={"ID":"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492","Type":"ContainerStarted","Data":"0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c"}
Jul 02 13:30:00.856828 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:00.856833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vlldq/must-gather-4rqr9" event={"ID":"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492","Type":"ContainerStarted","Data":"7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1"}
Jul 02 13:30:00.874503 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:00.874454    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vlldq/must-gather-4rqr9" podStartSLOduration=1.7364528510000001 podStartE2EDuration="7.874424371s" totalImagesPullingTime="6.13797152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:30:00.874046842 +0000 UTC m=+3071.606307234" watchObservedRunningTime="2026-07-02 13:30:00.874424371 +0000 UTC m=+3071.606684779"
Jul 02 13:30:05.408843 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:05.408808    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" podUID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" containerName="switch-graph-f7674" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:30:05.409312 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:05.408912    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:30:08.916708 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:08.916677    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:09.729331 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:09.729287    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:10.409536 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:10.409495    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" podUID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" containerName="switch-graph-f7674" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:30:10.547122 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:10.547095    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:11.336707 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:11.336676    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:12.132451 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:12.132409    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:12.952119 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:12.952087    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:13.830105 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:13.830069    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:14.669090 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:14.669058    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:15.408627 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:15.408584    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" podUID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" containerName="switch-graph-f7674" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:30:15.514197 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:15.514163    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:16.397581 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:16.397550    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:17.247193 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:17.247163    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:18.187851 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:18.187813    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:19.058236 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:19.058209    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:19.862391 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:19.862361    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-f7674-7d596db84c-9969j_5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/switch-graph-f7674/0.log"
Jul 02 13:30:20.409310 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:20.409271    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" podUID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" containerName="switch-graph-f7674" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 13:30:20.938406 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:20.938375    2560 generic.go:356] "Generic (PLEG): container finished" podID="52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" containerID="7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1" exitCode=0
Jul 02 13:30:20.938602 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:20.938464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vlldq/must-gather-4rqr9" event={"ID":"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492","Type":"ContainerDied","Data":"7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1"}
Jul 02 13:30:20.938766 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:20.938753    2560 scope.go:117] "RemoveContainer" containerID="7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1"
Jul 02 13:30:21.537361 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:21.537335    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vlldq_must-gather-4rqr9_52f6c18a-b84f-4672-8ebd-6dd4e5d6f492/gather/0.log"
Jul 02 13:30:22.818722 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.818692    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:30:22.916086 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.916058    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-proxy-tls\") pod \"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f\" (UID: \"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f\") "
Jul 02 13:30:22.916210 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.916097    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-openshift-service-ca-bundle\") pod \"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f\" (UID: \"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f\") "
Jul 02 13:30:22.916503 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.916481    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" (UID: "5ef42e84-c1c9-4b05-bc8d-9403af30bf3f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 13:30:22.918025 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.918002    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" (UID: "5ef42e84-c1c9-4b05-bc8d-9403af30bf3f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 13:30:22.945986 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.945964    2560 generic.go:356] "Generic (PLEG): container finished" podID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" containerID="726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656" exitCode=0
Jul 02 13:30:22.946089 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.946004    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"
Jul 02 13:30:22.946089 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.946061    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" event={"ID":"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f","Type":"ContainerDied","Data":"726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656"}
Jul 02 13:30:22.946181 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.946129    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j" event={"ID":"5ef42e84-c1c9-4b05-bc8d-9403af30bf3f","Type":"ContainerDied","Data":"1f50fedc70d4d67a165db3b63f9cfa9b2e70d392bd77e2dd2f59aadf8cce6881"}
Jul 02 13:30:22.946181 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.946151    2560 scope.go:117] "RemoveContainer" containerID="726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656"
Jul 02 13:30:22.953955 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.953935    2560 scope.go:117] "RemoveContainer" containerID="726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656"
Jul 02 13:30:22.954191 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:30:22.954175    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656\": container with ID starting with 726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656 not found: ID does not exist" containerID="726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656"
Jul 02 13:30:22.954255 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.954198    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656"} err="failed to get container status \"726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656\": rpc error: code = NotFound desc = could not find container \"726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656\": container with ID starting with 726813c2cb27f303e1d6e7104f94ac595b1feb692073ab06d256ea3c3cf7c656 not found: ID does not exist"
Jul 02 13:30:22.969231 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.969208    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"]
Jul 02 13:30:22.971807 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:22.971784    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-f7674-7d596db84c-9969j"]
Jul 02 13:30:23.017443 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:23.017413    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-proxy-tls\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:30:23.017510 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:23.017444    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f-openshift-service-ca-bundle\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:30:23.705496 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:23.705475    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" path="/var/lib/kubelet/pods/5ef42e84-c1c9-4b05-bc8d-9403af30bf3f/volumes"
Jul 02 13:30:24.638221 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:24.638195    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sw5dm_ba57525a-aa69-48d0-a51b-d631b1fde187/global-pull-secret-syncer/0.log"
Jul 02 13:30:24.757091 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:24.757065    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9rklj_ed9ea745-2599-4556-8d74-f24466245547/konnectivity-agent/0.log"
Jul 02 13:30:24.827413 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:24.827391    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-177.ec2.internal_5fb27810fb6dc0f9781a737032e64eed/haproxy/0.log"
Jul 02 13:30:26.939968 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:26.939936    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-vlldq/must-gather-4rqr9"]
Jul 02 13:30:26.940368 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:26.940111    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-vlldq/must-gather-4rqr9" podUID="52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" containerName="copy" containerID="cri-o://0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c" gracePeriod=2
Jul 02 13:30:26.945054 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:26.945024    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-vlldq/must-gather-4rqr9"]
Jul 02 13:30:27.166358 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.166339    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vlldq_must-gather-4rqr9_52f6c18a-b84f-4672-8ebd-6dd4e5d6f492/copy/0.log"
Jul 02 13:30:27.167932 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.167915    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vlldq/must-gather-4rqr9"
Jul 02 13:30:27.170411 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:30:27.170391    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-4rqr9\" is forbidden: User \"system:node:ip-10-0-128-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vlldq\": no relationship found between node 'ip-10-0-128-177.ec2.internal' and this object" podUID="52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" pod="openshift-must-gather-vlldq/must-gather-4rqr9"
Jul 02 13:30:27.247742 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.247694    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzbpg\" (UniqueName: \"kubernetes.io/projected/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-kube-api-access-bzbpg\") pod \"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492\" (UID: \"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492\") "
Jul 02 13:30:27.247742 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.247721    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-must-gather-output\") pod \"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492\" (UID: \"52f6c18a-b84f-4672-8ebd-6dd4e5d6f492\") "
Jul 02 13:30:27.249109 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.249087    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" (UID: "52f6c18a-b84f-4672-8ebd-6dd4e5d6f492"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 13:30:27.249685 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.249659    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-kube-api-access-bzbpg" (OuterVolumeSpecName: "kube-api-access-bzbpg") pod "52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" (UID: "52f6c18a-b84f-4672-8ebd-6dd4e5d6f492"). InnerVolumeSpecName "kube-api-access-bzbpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 13:30:27.348102 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.348081    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzbpg\" (UniqueName: \"kubernetes.io/projected/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-kube-api-access-bzbpg\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:30:27.348102 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.348102    2560 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492-must-gather-output\") on node \"ip-10-0-128-177.ec2.internal\" DevicePath \"\""
Jul 02 13:30:27.705271 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.705247    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" path="/var/lib/kubelet/pods/52f6c18a-b84f-4672-8ebd-6dd4e5d6f492/volumes"
Jul 02 13:30:27.969265 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.969215    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vlldq_must-gather-4rqr9_52f6c18a-b84f-4672-8ebd-6dd4e5d6f492/copy/0.log"
Jul 02 13:30:27.969588 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.969489    2560 generic.go:356] "Generic (PLEG): container finished" podID="52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" containerID="0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c" exitCode=143
Jul 02 13:30:27.969588 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.969537    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vlldq/must-gather-4rqr9"
Jul 02 13:30:27.969588 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.969577    2560 scope.go:117] "RemoveContainer" containerID="0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c"
Jul 02 13:30:27.976143 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.976126    2560 scope.go:117] "RemoveContainer" containerID="7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1"
Jul 02 13:30:27.987654 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.987633    2560 scope.go:117] "RemoveContainer" containerID="0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c"
Jul 02 13:30:27.987883 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:30:27.987864    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c\": container with ID starting with 0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c not found: ID does not exist" containerID="0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c"
Jul 02 13:30:27.987958 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.987898    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c"} err="failed to get container status \"0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c\": rpc error: code = NotFound desc = could not find container \"0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c\": container with ID starting with 0b2cf15e8e1839d154eef2e52ed29a07c2acb86aafeb9a91df0c22c8b4618f4c not found: ID does not exist"
Jul 02 13:30:27.987958 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.987923    2560 scope.go:117] "RemoveContainer" containerID="7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1"
Jul 02 13:30:27.988179 ip-10-0-128-177 kubenswrapper[2560]: E0702 13:30:27.988163    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1\": container with ID starting with 7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1 not found: ID does not exist" containerID="7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1"
Jul 02 13:30:27.988219 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:27.988185    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1"} err="failed to get container status \"7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1\": rpc error: code = NotFound desc = could not find container \"7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1\": container with ID starting with 7cbd45bf64efdd1ef40ddb3d34ac0ba3e8a4a38354cf9624edf103ac3fa503b1 not found: ID does not exist"
Jul 02 13:30:29.267127 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.267106    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-54dfx_cf5a102c-3cc3-4d71-b12b-4dbae6559ed9/node-exporter/0.log"
Jul 02 13:30:29.295447 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.295414    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-54dfx_cf5a102c-3cc3-4d71-b12b-4dbae6559ed9/kube-rbac-proxy/0.log"
Jul 02 13:30:29.322031 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.322012    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-54dfx_cf5a102c-3cc3-4d71-b12b-4dbae6559ed9/init-textfile/0.log"
Jul 02 13:30:29.621437 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.621415    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fafb552-296a-4a29-98c0-a7fef6253b3e/prometheus/0.log"
Jul 02 13:30:29.645903 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.645883    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fafb552-296a-4a29-98c0-a7fef6253b3e/config-reloader/0.log"
Jul 02 13:30:29.669740 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.669717    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fafb552-296a-4a29-98c0-a7fef6253b3e/thanos-sidecar/0.log"
Jul 02 13:30:29.694779 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.694743    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fafb552-296a-4a29-98c0-a7fef6253b3e/kube-rbac-proxy-web/0.log"
Jul 02 13:30:29.727022 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.726986    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fafb552-296a-4a29-98c0-a7fef6253b3e/kube-rbac-proxy/0.log"
Jul 02 13:30:29.752977 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.752960    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fafb552-296a-4a29-98c0-a7fef6253b3e/kube-rbac-proxy-thanos/0.log"
Jul 02 13:30:29.777118 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.777104    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5fafb552-296a-4a29-98c0-a7fef6253b3e/init-config-reloader/0.log"
Jul 02 13:30:29.805741 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.805725    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-xxbgb_88d662f7-9de5-4483-904b-1e95c8af917d/prometheus-operator/0.log"
Jul 02 13:30:29.828786 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.828760    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-xxbgb_88d662f7-9de5-4483-904b-1e95c8af917d/kube-rbac-proxy/0.log"
Jul 02 13:30:29.855174 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:29.855145    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-rz2lw_09929368-4d9f-4c60-9849-086097d381f7/prometheus-operator-admission-webhook/0.log"
Jul 02 13:30:32.393057 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:32.393031    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-52k77_901f9009-f609-476f-ba60-0a346db71f86/download-server/0.log"
Jul 02 13:30:33.097775 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.097749    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"]
Jul 02 13:30:33.098006 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.097995    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" containerName="copy"
Jul 02 13:30:33.098061 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.098007    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" containerName="copy"
Jul 02 13:30:33.098061 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.098014    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" containerName="switch-graph-f7674"
Jul 02 13:30:33.098061 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.098020    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" containerName="switch-graph-f7674"
Jul 02 13:30:33.098061 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.098032    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" containerName="gather"
Jul 02 13:30:33.098061 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.098047    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" containerName="gather"
Jul 02 13:30:33.098218 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.098091    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef42e84-c1c9-4b05-bc8d-9403af30bf3f" containerName="switch-graph-f7674"
Jul 02 13:30:33.098218 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.098099    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" containerName="copy"
Jul 02 13:30:33.098218 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.098105    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="52f6c18a-b84f-4672-8ebd-6dd4e5d6f492" containerName="gather"
Jul 02 13:30:33.099774 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.099759    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.102750 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.102734    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74fjg\"/\"openshift-service-ca.crt\""
Jul 02 13:30:33.103002 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.102985    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74fjg\"/\"kube-root-ca.crt\""
Jul 02 13:30:33.104393 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.104376    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-74fjg\"/\"default-dockercfg-djlrx\""
Jul 02 13:30:33.110270 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.110244    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"]
Jul 02 13:30:33.186889 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.186865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-sys\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.186981 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.186894    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-podres\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.186981 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.186919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fmpv\" (UniqueName: \"kubernetes.io/projected/bea34845-e57d-4e6b-b3ae-d95c276ceb75-kube-api-access-6fmpv\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.187049 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.186999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-proc\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.187049 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.187020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-lib-modules\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.287764 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.287741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-sys\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.287845 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.287766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-podres\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.287845 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.287788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fmpv\" (UniqueName: \"kubernetes.io/projected/bea34845-e57d-4e6b-b3ae-d95c276ceb75-kube-api-access-6fmpv\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.287845 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.287809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-proc\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.287845 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.287827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-lib-modules\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.287995 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.287855    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-sys\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.287995 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.287901    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-proc\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.287995 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.287916    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-podres\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.287995 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.287962    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bea34845-e57d-4e6b-b3ae-d95c276ceb75-lib-modules\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.296113 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.296093    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fmpv\" (UniqueName: \"kubernetes.io/projected/bea34845-e57d-4e6b-b3ae-d95c276ceb75-kube-api-access-6fmpv\") pod \"perf-node-gather-daemonset-xq6px\" (UID: \"bea34845-e57d-4e6b-b3ae-d95c276ceb75\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.409002 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.408949    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:33.527715 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.527691    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"]
Jul 02 13:30:33.529854 ip-10-0-128-177 kubenswrapper[2560]: W0702 13:30:33.529830    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbea34845_e57d_4e6b_b3ae_d95c276ceb75.slice/crio-4e0d1b0493eeaa0def2fe480afbca1b0d74df44413b9529f2ed7fd3b1d11c38c WatchSource:0}: Error finding container 4e0d1b0493eeaa0def2fe480afbca1b0d74df44413b9529f2ed7fd3b1d11c38c: Status 404 returned error can't find the container with id 4e0d1b0493eeaa0def2fe480afbca1b0d74df44413b9529f2ed7fd3b1d11c38c
Jul 02 13:30:33.904840 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.904819    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n9b25_82e35c4f-943a-409c-97b6-bae9430d9e00/dns/0.log"
Jul 02 13:30:33.926391 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.926374    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n9b25_82e35c4f-943a-409c-97b6-bae9430d9e00/kube-rbac-proxy/0.log"
Jul 02 13:30:33.991199 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.991174    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px" event={"ID":"bea34845-e57d-4e6b-b3ae-d95c276ceb75","Type":"ContainerStarted","Data":"f0cffe8a290f963a07619928fb26035be7a98f328d381d8938bc6810249a52b8"}
Jul 02 13:30:33.991283 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.991222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px" event={"ID":"bea34845-e57d-4e6b-b3ae-d95c276ceb75","Type":"ContainerStarted","Data":"4e0d1b0493eeaa0def2fe480afbca1b0d74df44413b9529f2ed7fd3b1d11c38c"}
Jul 02 13:30:33.991326 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:33.991289    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:34.013506 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:34.013473    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px" podStartSLOduration=1.013461999 podStartE2EDuration="1.013461999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:30:34.01159594 +0000 UTC m=+3104.743856360" watchObservedRunningTime="2026-07-02 13:30:34.013461999 +0000 UTC m=+3104.745722408"
Jul 02 13:30:34.062095 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:34.062080    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-drc6k_ead7f268-0162-428f-9cf4-f72141d2c2f3/dns-node-resolver/0.log"
Jul 02 13:30:34.567707 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:34.567686    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75755fbc89-7h7vm_5eb82eb9-e022-4de7-96ca-f2c690a41de1/registry/0.log"
Jul 02 13:30:34.647143 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:34.647126    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tq8xq_ca69c8d9-e134-41f9-98fb-52721bed505f/node-ca/0.log"
Jul 02 13:30:35.955750 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:35.955723    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-snlz4_62852525-9ae2-46c5-8b60-27242d35ec23/serve-healthcheck-canary/0.log"
Jul 02 13:30:36.438214 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:36.438190    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwl5h_183c86a9-263c-45d5-90ba-f694ecad4315/kube-rbac-proxy/0.log"
Jul 02 13:30:36.460843 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:36.460827    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwl5h_183c86a9-263c-45d5-90ba-f694ecad4315/exporter/0.log"
Jul 02 13:30:36.483331 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:36.483312    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwl5h_183c86a9-263c-45d5-90ba-f694ecad4315/extractor/0.log"
Jul 02 13:30:38.814778 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:38.814750    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-mm69k_b9a255d4-963e-4778-a4d2-589b36c4ec59/s3-init/0.log"
Jul 02 13:30:38.835770 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:38.835744    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-mm69k_b9a255d4-963e-4778-a4d2-589b36c4ec59/download-hf-model/0.log"
Jul 02 13:30:40.003821 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:40.003794    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-xq6px"
Jul 02 13:30:42.605420 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:42.605385    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-ms474_639273cb-e29e-417c-9e8f-2c03a72bca82/migrator/0.log"
Jul 02 13:30:42.643796 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:42.643765    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-ms474_639273cb-e29e-417c-9e8f-2c03a72bca82/graceful-termination/0.log"
Jul 02 13:30:44.488763 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:44.488735    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s228p_734fdd4c-fc93-4f2e-bdea-b7d72b2d646e/kube-multus-additional-cni-plugins/0.log"
Jul 02 13:30:44.511482 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:44.511458    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s228p_734fdd4c-fc93-4f2e-bdea-b7d72b2d646e/egress-router-binary-copy/0.log"
Jul 02 13:30:44.535781 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:44.535754    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s228p_734fdd4c-fc93-4f2e-bdea-b7d72b2d646e/cni-plugins/0.log"
Jul 02 13:30:44.559346 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:44.559321    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s228p_734fdd4c-fc93-4f2e-bdea-b7d72b2d646e/bond-cni-plugin/0.log"
Jul 02 13:30:44.581315 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:44.581295    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s228p_734fdd4c-fc93-4f2e-bdea-b7d72b2d646e/routeoverride-cni/0.log"
Jul 02 13:30:44.607105 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:44.607080    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s228p_734fdd4c-fc93-4f2e-bdea-b7d72b2d646e/whereabouts-cni-bincopy/0.log"
Jul 02 13:30:44.631926 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:44.631901    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s228p_734fdd4c-fc93-4f2e-bdea-b7d72b2d646e/whereabouts-cni/0.log"
Jul 02 13:30:44.662891 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:44.662867    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jl58l_cd7d04ce-d45e-4afd-9ee3-59ee3d41450d/kube-multus/0.log"
Jul 02 13:30:44.781400 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:44.781311    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-srq4r_d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc/network-metrics-daemon/0.log"
Jul 02 13:30:44.802125 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:44.802099    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-srq4r_d9f189e7-80f1-4a4c-8c4a-b05fa6f549cc/kube-rbac-proxy/0.log"
Jul 02 13:30:46.440504 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:46.440472    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-controller/0.log"
Jul 02 13:30:46.491985 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:46.491961    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/0.log"
Jul 02 13:30:46.491985 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:46.491961    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovn-acl-logging/1.log"
Jul 02 13:30:46.527703 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:46.527678    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/kube-rbac-proxy-node/0.log"
Jul 02 13:30:46.572775 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:46.572750    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/kube-rbac-proxy-ovn-metrics/0.log"
Jul 02 13:30:46.608476 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:46.608453    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/northd/0.log"
Jul 02 13:30:46.631798 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:46.631776    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/nbdb/0.log"
Jul 02 13:30:46.657386 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:46.657364    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/sbdb/0.log"
Jul 02 13:30:46.705502 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:46.705397    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sv8zr_2cf6e252-53bd-4150-af7b-0bd18556f36a/ovnkube-controller/0.log"
Jul 02 13:30:47.732241 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:47.732210    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dhszc_a40b3102-c663-4d18-b41b-84c6ae90d57c/network-check-target-container/0.log"
Jul 02 13:30:48.744294 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:48.744262    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-rwsc6_cef66cb7-ba61-4dc2-ace0-a2b3558bbb37/iptables-alerter/0.log"
Jul 02 13:30:49.353968 ip-10-0-128-177 kubenswrapper[2560]: I0702 13:30:49.353940    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qbqgv_e5bb6aab-d910-4279-9ead-0dbd2ac37d3a/tuned/0.log"