May 20 15:29:06.659379 ip-10-0-135-174 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 20 15:29:06.659390 ip-10-0-135-174 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 20 15:29:06.659398 ip-10-0-135-174 systemd[1]: kubelet.service: Failed with result 'resources'.
May 20 15:29:06.659668 ip-10-0-135-174 systemd[1]: Failed to start Kubernetes Kubelet.
May 20 15:29:16.891878 ip-10-0-135-174 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 20 15:29:16.891897 ip-10-0-135-174 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ebedf08f0ad6425b94b11f53af6c0c47 --
May 20 15:31:49.008485 ip-10-0-135-174 systemd[1]: Starting Kubernetes Kubelet...
May 20 15:31:49.445189 ip-10-0-135-174 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 15:31:49.445189 ip-10-0-135-174 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 20 15:31:49.445189 ip-10-0-135-174 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 15:31:49.445189 ip-10-0-135-174 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 20 15:31:49.445722 ip-10-0-135-174 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 15:31:49.446046 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.445975    2551 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 20 15:31:49.450447 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450432    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 15:31:49.450447 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450446    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450450    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450454    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450457    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450460    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450462    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450465    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450467    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450470    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450472    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450475    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450477    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450480    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450482    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450485    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450487    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450490    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450493    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450495    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450498    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 15:31:49.450508 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450500    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450503    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450505    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450510    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450513    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450516    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450518    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450521    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450525    2551 feature_gate.go:328] unrecognized feature gate: Example
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450527    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450530    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450532    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450535    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450537    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450540    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450543    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450545    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450548    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450550    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450552    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 15:31:49.450973 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450555    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450559    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450562    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450565    2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450568    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450570    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450573    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450575    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450578    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450581    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450583    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450586    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450588    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450590    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450593    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450596    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450598    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450601    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450603    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450606    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 15:31:49.451491 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450608    2551 feature_gate.go:328] unrecognized feature gate: Example2
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450610    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450613    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450615    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450618    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450620    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450623    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450625    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450630    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450634    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450637    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450640    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450642    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450646    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450649    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450652    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450655    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450657    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450660    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 15:31:49.451968 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450662    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450665    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450668    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450670    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450673    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.450675    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451030    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451036    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451038    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451041    2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451044    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451047    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451049    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451052    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451054    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451057    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451059    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451062    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451064    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 15:31:49.452438 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451066    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451069    2551 feature_gate.go:328] unrecognized feature gate: Example2
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451072    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451074    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451076    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451079    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451082    2551 feature_gate.go:328] unrecognized feature gate: Example
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451085    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451088    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451091    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451093    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451096    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451099    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451101    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451104    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451125    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451135    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451137    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451140    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451142    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 15:31:49.452893 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451145    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451148    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451150    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451153    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451155    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451158    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451160    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451163    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451165    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451168    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451170    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451173    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451178    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451182    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451184    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451187    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451190    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451192    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451195    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451198    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 15:31:49.453425 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451201    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451204    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451206    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451209    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451211    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451213    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451216    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451218    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451221    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451223    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451226    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451228    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451231    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451233    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451236    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451238    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451241    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451243    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451246    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451248    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 15:31:49.453914 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451250    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451253    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451256    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451258    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451261    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451263    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451266    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451268    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451270    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451274    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451277    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451280    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.451284    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452030    2551 flags.go:64] FLAG: --address="0.0.0.0"
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452039    2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452045    2551 flags.go:64] FLAG: --anonymous-auth="true"
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452049    2551 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452053    2551 flags.go:64] FLAG: --authentication-token-webhook="false"
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452056    2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452060    2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452064    2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 20 15:31:49.454484 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452067    2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452070    2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452074    2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452078    2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452081    2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452084    2551 flags.go:64] FLAG: --cgroup-root=""
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452086    2551 flags.go:64] FLAG: --cgroups-per-qos="true"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452089    2551 flags.go:64] FLAG: --client-ca-file=""
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452092    2551 flags.go:64] FLAG: --cloud-config=""
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452095    2551 flags.go:64] FLAG: --cloud-provider="external"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452098    2551 flags.go:64] FLAG: --cluster-dns="[]"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452102    2551 flags.go:64] FLAG: --cluster-domain=""
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452104    2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452122    2551 flags.go:64] FLAG: --config-dir=""
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452125    2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452128    2551 flags.go:64] FLAG: --container-log-max-files="5"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452132    2551 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452135    2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452138    2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452142    2551 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452144    2551 flags.go:64] FLAG: --contention-profiling="false"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452148    2551 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452151    2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452154    2551 flags.go:64] FLAG: --cpu-manager-policy="none"
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452158    2551 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 20 15:31:49.455000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452163    2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452166    2551 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452169    2551 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452171    2551 flags.go:64] FLAG: --enable-load-reader="false"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452174    2551 flags.go:64] FLAG: --enable-server="true"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452177    2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452181    2551 flags.go:64] FLAG: --event-burst="100"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452184    2551 flags.go:64] FLAG: --event-qps="50"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452187    2551 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452190    2551 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452193    2551 flags.go:64] FLAG: --eviction-hard=""
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452196    2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452199    2551 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452202    2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452205    2551 flags.go:64] FLAG: --eviction-soft=""
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452207    2551 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452210    2551 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452213    2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452216    2551 flags.go:64] FLAG: --experimental-mounter-path=""
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452218    2551 flags.go:64] FLAG: --fail-cgroupv1="false"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452221    2551 flags.go:64] FLAG: --fail-swap-on="true"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452224    2551 flags.go:64] FLAG: --feature-gates=""
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452227    2551 flags.go:64] FLAG: --file-check-frequency="20s"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452230    2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452233    2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 20 15:31:49.455627 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452236    2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452239    2551 flags.go:64] FLAG: --healthz-port="10248"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452241    2551 flags.go:64] FLAG: --help="false"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452245    2551 flags.go:64] FLAG: --hostname-override="ip-10-0-135-174.ec2.internal"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452248    2551 flags.go:64] FLAG: --housekeeping-interval="10s"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452251    2551 flags.go:64] FLAG: --http-check-frequency="20s"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452254    2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452257    2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452261    2551 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452264    2551 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452266    2551 flags.go:64] FLAG: --image-service-endpoint=""
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452269    2551 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452271    2551 flags.go:64] FLAG: --kube-api-burst="100"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452274    2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452277    2551 flags.go:64] FLAG: --kube-api-qps="50"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452280    2551 flags.go:64] FLAG: --kube-reserved=""
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452282    2551 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452285    2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452288    2551 flags.go:64] FLAG: --kubelet-cgroups=""
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452290    2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452293    2551 flags.go:64] FLAG: --lock-file=""
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452296    2551 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452298    2551 flags.go:64] FLAG: --log-flush-frequency="5s"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452301    2551 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 20 15:31:49.456240 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452306    2551 flags.go:64] FLAG: --log-json-split-stream="false"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452309    2551 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452311    2551 flags.go:64] FLAG: --log-text-split-stream="false"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452314    2551 flags.go:64] FLAG: --logging-format="text"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452317    2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452320    2551 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452322    2551 flags.go:64] FLAG: --manifest-url=""
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452325    2551 flags.go:64] FLAG: --manifest-url-header=""
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452330    2551 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452333    2551 flags.go:64] FLAG: --max-open-files="1000000"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452337    2551 flags.go:64] FLAG: --max-pods="110"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452339    2551 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452342    2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452345    2551 flags.go:64] FLAG: --memory-manager-policy="None"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452348    2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452351    2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452354    2551 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452357    2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452364    2551 flags.go:64] FLAG: --node-status-max-images="50"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452367    2551 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452370    2551 flags.go:64] FLAG: --oom-score-adj="-999"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452373    2551 flags.go:64] FLAG: --pod-cidr=""
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452376    2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 20 15:31:49.456811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452381    2551 flags.go:64] FLAG: --pod-manifest-path=""
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452383    2551 flags.go:64] FLAG: --pod-max-pids="-1"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452386    2551 flags.go:64] FLAG: --pods-per-core="0"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452389    2551 flags.go:64] FLAG: --port="10250"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452392    2551 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452394    2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ef9c6fb284754c65"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452397    2551 flags.go:64] FLAG: --qos-reserved=""
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452400    2551 flags.go:64] FLAG: --read-only-port="10255"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452403    2551 flags.go:64] FLAG: --register-node="true"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452406    2551 flags.go:64] FLAG: --register-schedulable="true"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452408    2551 flags.go:64] FLAG: --register-with-taints=""
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452412    2551 flags.go:64] FLAG: --registry-burst="10"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452414    2551 flags.go:64] FLAG: --registry-qps="5"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452417    2551 flags.go:64] FLAG: --reserved-cpus=""
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452420    2551 flags.go:64] FLAG: --reserved-memory=""
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452427    2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452430    2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452433    2551 flags.go:64] FLAG: --rotate-certificates="false"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452436    2551 flags.go:64] FLAG: --rotate-server-certificates="false"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452439    2551 flags.go:64] FLAG: --runonce="false"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452442    2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452445    2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452448    2551 flags.go:64] FLAG: --seccomp-default="false"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452451    2551 flags.go:64] FLAG: --serialize-image-pulls="true"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452454    2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452457    2551 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 20 15:31:49.457360 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452459    2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452463    2551 flags.go:64] FLAG: --storage-driver-password="root"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452466    2551 flags.go:64] FLAG: --storage-driver-secure="false"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452469    2551 flags.go:64] FLAG: --storage-driver-table="stats"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452471    2551 flags.go:64] FLAG: --storage-driver-user="root"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452474    2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452477    2551 flags.go:64] FLAG: --sync-frequency="1m0s"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452480    2551 flags.go:64] FLAG: --system-cgroups=""
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452482    2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452487    2551 flags.go:64] FLAG: --system-reserved-cgroup=""
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452490    2551 flags.go:64] FLAG: --tls-cert-file=""
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452493    2551 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452497    2551 flags.go:64] FLAG: --tls-min-version=""
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452499    2551 flags.go:64] FLAG: --tls-private-key-file=""
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452502    2551 flags.go:64] FLAG: --topology-manager-policy="none"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452505    2551 flags.go:64] FLAG: --topology-manager-policy-options=""
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452507    2551 flags.go:64] FLAG: --topology-manager-scope="container"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452510    2551 flags.go:64] FLAG: --v="2"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452514    2551 flags.go:64] FLAG: --version="false"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452517    2551 flags.go:64] FLAG: --vmodule=""
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452525    2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.452528    2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452609    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452613    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 15:31:49.458000 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452616    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452619    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452622    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452625    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452628    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452631    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452634    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452637    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452639    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452642    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452645    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452648    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452651    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452653    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452656    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452659    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452661    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452663    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452666    2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452668    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 15:31:49.458616 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452671    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452673    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452676    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452678    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452681    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452683    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452686    2551 feature_gate.go:328] unrecognized feature gate: Example2
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452688    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452694    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452696    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452699    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452701    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452704    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452706    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452709    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452711    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452714    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452716    2551 feature_gate.go:328] unrecognized feature gate: Example
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452719    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452721    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 15:31:49.459129 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452724    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452726    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452729    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452732    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452734    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452736    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452739    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452741    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452744    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452746    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452749    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452751    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452753    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452756    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452759    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452763    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452766    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452768    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452771    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452773    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 15:31:49.459615 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452778    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452780    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452783    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452786    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452790    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452793    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452795    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452798    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452800    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452802    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452805    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452807    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452810    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452812    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452815    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452817    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452820    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452823    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452826    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 15:31:49.460098 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452828    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452830    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452833    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452835    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.452837    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.453420    2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.459214    2551 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.459228    2551 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459273    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459279    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459283    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459286    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459289    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459292    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459295    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 15:31:49.460610 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459298    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459302    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459305    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459307    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459311    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459313    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459316    2551 feature_gate.go:328] unrecognized feature gate: Example2
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459319    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459321    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459324    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459326    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459329    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459331    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459334    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459337    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459339    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459342    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459345    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459347    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459350    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 15:31:49.460998 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459352    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459355    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459357    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459361    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459365    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459368    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459371    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459374    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459376    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459379    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459381    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459383    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459386    2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459389    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459391    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459394    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459396    2551 feature_gate.go:328] unrecognized feature gate: Example
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459399    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459401    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459404    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 15:31:49.461493 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459406    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459409    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459411    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459414    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459416    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459420    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459424    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459435    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459438    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459441    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459444    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459447    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459450    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459452    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459455    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459459    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459462    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459465    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459468    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 15:31:49.461995 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459470    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459473    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459475    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459478    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459481    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459483    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459486    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459488    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459491    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459493    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459496    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459498    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459500    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459503    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459505    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459508    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459510    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459513    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459515    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 15:31:49.462472 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459517    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.459522    2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459635    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459640    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459643    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459646    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459649    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459652    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459655    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459659    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459663    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459666    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459669    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459671    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459674    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 15:31:49.462975 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459676    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459679    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459681    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459683    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459686    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459688    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459690    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459693    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459695    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459698    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459700    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459703    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459705    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459707    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459710    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459712    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459715    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459717    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459719    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459722    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 15:31:49.463377 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459732    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459734    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459737    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459739    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459742    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459744    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459747    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459750    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459752    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459755    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459757    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459760    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459762    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459765    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459767    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459769    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459772    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459774    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459778    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 15:31:49.463882 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459781    2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459784    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459787    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459790    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459793    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459795    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459798    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459800    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459803    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459805    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459808    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459810    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459813    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459815    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459823    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459826    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459828    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459830    2551 feature_gate.go:328] unrecognized feature gate: Example2
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459833    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459835    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 15:31:49.464354 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459838    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459841    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459843    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459845    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459848    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459850    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459852    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459855    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459857    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459859    2551 feature_gate.go:328] unrecognized feature gate: Example
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459862    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459864    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459867    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:49.459869    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.459874    2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 15:31:49.464832 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.460578    2551 server.go:962] "Client rotation is on, will bootstrap in background"
May 20 15:31:49.465219 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.462635    2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 20 15:31:49.465219 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.463492    2551 server.go:1019] "Starting client certificate rotation"
May 20 15:31:49.465219 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.463582    2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 15:31:49.465219 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.463615    2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 15:31:49.487519 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.487502    2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 15:31:49.491494 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.491480    2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 15:31:49.504560 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.504544    2551 log.go:25] "Validated CRI v1 runtime API"
May 20 15:31:49.509421 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.509404    2551 log.go:25] "Validated CRI v1 image API"
May 20 15:31:49.511263 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.511247    2551 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 20 15:31:49.515606 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.515588    2551 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 abe7ca63-c8f3-437f-83d5-74afd9d5f42e:/dev/nvme0n1p4 ef02905a-22a6-45b9-b4d4-374f8e797253:/dev/nvme0n1p3]
May 20 15:31:49.515658 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.515607    2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 20 15:31:49.519638 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.519622    2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 15:31:49.520264 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.520157    2551 manager.go:217] Machine: {Timestamp:2026-05-20 15:31:49.519645059 +0000 UTC m=+0.393646791 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098314 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fa656b3057e2fc2314da0b813cf46 SystemUUID:ec2fa656-b305-7e2f-c231-4da0b813cf46 BootID:ebedf08f-0ad6-425b-94b1-1f53af6c0c47 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ae:58:3c:7a:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ae:58:3c:7a:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:c2:4a:89:25:a1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 20 15:31:49.521445 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.521434    2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 20 15:31:49.521527 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.521513    2551 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 20 15:31:49.523247 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.523223    2551 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 20 15:31:49.523388 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.523249    2551 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-174.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 20 15:31:49.523435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.523398    2551 topology_manager.go:138] "Creating topology manager with none policy"
May 20 15:31:49.523435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.523407    2551 container_manager_linux.go:306] "Creating device plugin manager"
May 20 15:31:49.523435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.523415    2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 15:31:49.524058 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.524049    2551 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 15:31:49.526128 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.526119    2551 state_mem.go:36] "Initialized new in-memory state store"
May 20 15:31:49.526231 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.526222    2551 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 20 15:31:49.528387 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.528377    2551 kubelet.go:491] "Attempting to sync node with API server"
May 20 15:31:49.528418 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.528393    2551 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 20 15:31:49.528418 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.528404    2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 20 15:31:49.528418 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.528414    2551 kubelet.go:397] "Adding apiserver pod source"
May 20 15:31:49.528523 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.528422    2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 20 15:31:49.529481 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.529466    2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 15:31:49.529556 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.529493    2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 15:31:49.533260 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.533241    2551 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 20 15:31:49.535301 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.535288    2551 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 20 15:31:49.536211 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536199    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 20 15:31:49.536246 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536217    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 20 15:31:49.536246 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536224    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 20 15:31:49.536246 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536230    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 20 15:31:49.536246 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536238    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 20 15:31:49.536246 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536243    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 20 15:31:49.536397 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536249    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 20 15:31:49.536397 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536254    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 20 15:31:49.536397 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536262    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 20 15:31:49.536397 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536267    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 20 15:31:49.536397 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536284    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 20 15:31:49.536618 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.536443    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 20 15:31:49.537212 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.537202    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 20 15:31:49.537212 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.537212    2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 20 15:31:49.540026 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.540012    2551 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 20 15:31:49.540102 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.540043    2551 server.go:1295] "Started kubelet"
May 20 15:31:49.540215 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.540125    2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 20 15:31:49.540248 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.540169    2551 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 20 15:31:49.540279 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.540255    2551 server_v1.go:47] "podresources" method="list" useActivePods=true
May 20 15:31:49.540766 ip-10-0-135-174 systemd[1]: Started Kubernetes Kubelet.
May 20 15:31:49.541182 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.541162    2551 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 20 15:31:49.543062 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.543042    2551 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-174.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 20 15:31:49.543211 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.543101    2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 20 15:31:49.543284 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.543218    2551 server.go:317] "Adding debug handlers to kubelet server"
May 20 15:31:49.543856 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.543135    2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 20 15:31:49.544312 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.544289    2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x4wbj"
May 20 15:31:49.548981 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.548949    2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 20 15:31:49.549674 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.549653    2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 20 15:31:49.549770 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.549757    2551 volume_manager.go:295] "The desired_state_of_world populator starts"
May 20 15:31:49.549824 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.549774    2551 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 20 15:31:49.549888 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.549876    2551 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 20 15:31:49.549955 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.549945    2551 reconstruct.go:97] "Volume reconstruction finished"
May 20 15:31:49.549988 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.549955    2551 reconciler.go:26] "Reconciler: start to sync state"
May 20 15:31:49.550822 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.550539    2551 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 20 15:31:49.550968 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.550953    2551 factory.go:55] Registering systemd factory
May 20 15:31:49.550968 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.550968    2551 factory.go:223] Registration of the systemd container factory successfully
May 20 15:31:49.551205 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.551191    2551 factory.go:153] Registering CRI-O factory
May 20 15:31:49.551276 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.551209    2551 factory.go:223] Registration of the crio container factory successfully
May 20 15:31:49.551276 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.551271    2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 20 15:31:49.551372 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.551287    2551 factory.go:103] Registering Raw factory
May 20 15:31:49.551372 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.551317    2551 manager.go:1196] Started watching for new ooms in manager
May 20 15:31:49.551659 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.547123    2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-174.ec2.internal.18b14fd64824d128  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-174.ec2.internal,UID:ip-10-0-135-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-174.ec2.internal,},FirstTimestamp:2026-05-20 15:31:49.540024616 +0000 UTC m=+0.414026348,LastTimestamp:2026-05-20 15:31:49.540024616 +0000 UTC m=+0.414026348,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-174.ec2.internal,}"
May 20 15:31:49.551769 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.551714    2551 manager.go:319] Starting recovery of all containers
May 20 15:31:49.552449 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.552426    2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x4wbj"
May 20 15:31:49.552958 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.552939    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:49.553209 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.553187    2551 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 20 15:31:49.553328 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.553255    2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 20 15:31:49.559678 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.559512    2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 20 15:31:49.562061 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.562041    2551 manager.go:324] Recovery completed
May 20 15:31:49.566145 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.566131    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:31:49.568048 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.568033    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:31:49.568126 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.568059    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:31:49.568126 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.568069    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
May 20 15:31:49.568586 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.568569    2551 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 20 15:31:49.568586 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.568583    2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 20 15:31:49.568747 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.568599    2551 state_mem.go:36] "Initialized new in-memory state store"
May 20 15:31:49.571193 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.571180    2551 policy_none.go:49] "None policy: Start"
May 20 15:31:49.571274 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.571203    2551 memory_manager.go:186] "Starting memorymanager" policy="None"
May 20 15:31:49.571274 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.571216    2551 state_mem.go:35] "Initializing new in-memory state store"
May 20 15:31:49.603662 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.603648    2551 manager.go:341] "Starting Device Plugin manager"
May 20 15:31:49.603730 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.603675    2551 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 20 15:31:49.603730 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.603686    2551 server.go:85] "Starting device plugin registration server"
May 20 15:31:49.603913 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.603897    2551 eviction_manager.go:189] "Eviction manager: starting control loop"
May 20 15:31:49.604005 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.603914    2551 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 20 15:31:49.604066 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.604041    2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 20 15:31:49.604136 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.604105    2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 20 15:31:49.604136 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.604133    2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 20 15:31:49.604623 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.604603    2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 20 15:31:49.604722 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.604665    2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:49.687205 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.687183    2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 20 15:31:49.687205 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.687206    2551 status_manager.go:230] "Starting to sync pod status with apiserver"
May 20 15:31:49.687371 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.687221    2551 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 20 15:31:49.687371 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.687228    2551 kubelet.go:2451] "Starting kubelet main sync loop"
May 20 15:31:49.687371 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.687267    2551 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 20 15:31:49.689675 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.689658    2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 15:31:49.704822 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.704779    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:31:49.705513 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.705492    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:31:49.705597 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.705532    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:31:49.705597 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.705547    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
May 20 15:31:49.705597 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.705575    2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-174.ec2.internal"
May 20 15:31:49.715758 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.715742    2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-174.ec2.internal"
May 20 15:31:49.715816 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.715760    2551 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-174.ec2.internal\": node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:49.730367 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.730348    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:49.788367 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.788323    2551 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"]
May 20 15:31:49.788446 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.788419    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:31:49.789166 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.789150    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:31:49.789241 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.789178    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:31:49.789241 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.789188    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
May 20 15:31:49.790304 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.790292    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:31:49.790471 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.790455    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
May 20 15:31:49.790516 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.790485    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:31:49.790954 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.790938    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:31:49.791039 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.790959    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:31:49.791039 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.790972    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
May 20 15:31:49.791039 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.790944    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:31:49.791039 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.791009    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:31:49.791039 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.791021    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
May 20 15:31:49.792046 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.792033    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
May 20 15:31:49.792127 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.792054    2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 15:31:49.792700 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.792682    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientMemory"
May 20 15:31:49.792768 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.792711    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasNoDiskPressure"
May 20 15:31:49.792768 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.792720    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeHasSufficientPID"
May 20 15:31:49.823661 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.823645    2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-174.ec2.internal\" not found" node="ip-10-0-135-174.ec2.internal"
May 20 15:31:49.827808 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.827792    2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-174.ec2.internal\" not found" node="ip-10-0-135-174.ec2.internal"
May 20 15:31:49.830848 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.830834    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:49.852005 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.851982    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb002dad605934aeb5aadadf48569211-config\") pod \"kube-apiserver-proxy-ip-10-0-135-174.ec2.internal\" (UID: \"eb002dad605934aeb5aadadf48569211\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
May 20 15:31:49.852093 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.852014    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09b2b39605c9d5bd54825b8a1b8b3d30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"09b2b39605c9d5bd54825b8a1b8b3d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
May 20 15:31:49.852093 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.852037    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b2b39605c9d5bd54825b8a1b8b3d30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"09b2b39605c9d5bd54825b8a1b8b3d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
May 20 15:31:49.931015 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:49.930994    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:49.952357 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.952333    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb002dad605934aeb5aadadf48569211-config\") pod \"kube-apiserver-proxy-ip-10-0-135-174.ec2.internal\" (UID: \"eb002dad605934aeb5aadadf48569211\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
May 20 15:31:49.952423 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.952366    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09b2b39605c9d5bd54825b8a1b8b3d30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"09b2b39605c9d5bd54825b8a1b8b3d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
May 20 15:31:49.952423 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.952382    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b2b39605c9d5bd54825b8a1b8b3d30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"09b2b39605c9d5bd54825b8a1b8b3d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
May 20 15:31:49.952524 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.952430    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09b2b39605c9d5bd54825b8a1b8b3d30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"09b2b39605c9d5bd54825b8a1b8b3d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
May 20 15:31:49.952524 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.952445    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb002dad605934aeb5aadadf48569211-config\") pod \"kube-apiserver-proxy-ip-10-0-135-174.ec2.internal\" (UID: \"eb002dad605934aeb5aadadf48569211\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
May 20 15:31:49.952524 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:49.952494    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b2b39605c9d5bd54825b8a1b8b3d30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal\" (UID: \"09b2b39605c9d5bd54825b8a1b8b3d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
May 20 15:31:50.031622 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:50.031570    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:50.126162 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.126136    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
May 20 15:31:50.130806 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.130786    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
May 20 15:31:50.131849 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:50.131834    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:50.232937 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:50.232911    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:50.333518 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:50.333447    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:50.433944 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:50.433912    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:50.463456 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.463434    2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 20 15:31:50.463929 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.463604    2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 15:31:50.534945 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:50.534921    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:50.549899 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.549875    2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 20 15:31:50.555289 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.555262    2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 15:26:49 +0000 UTC" deadline="2027-12-07 20:08:15.796475716 +0000 UTC"
May 20 15:31:50.555289 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.555287    2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13588h36m25.241191055s"
May 20 15:31:50.564829 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.564811    2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 15:31:50.567712 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.567695    2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 15:31:50.592265 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.592245    2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-knzh5"
May 20 15:31:50.598249 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.598230    2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-knzh5"
May 20 15:31:50.635931 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:50.635907    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:50.647255 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:50.647227    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb002dad605934aeb5aadadf48569211.slice/crio-97a49388444a4c295dcb005e0b470993347bdec7e5157cc9250fad2dcd94e1a8 WatchSource:0}: Error finding container 97a49388444a4c295dcb005e0b470993347bdec7e5157cc9250fad2dcd94e1a8: Status 404 returned error can't find the container with id 97a49388444a4c295dcb005e0b470993347bdec7e5157cc9250fad2dcd94e1a8
May 20 15:31:50.647471 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:50.647452    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b2b39605c9d5bd54825b8a1b8b3d30.slice/crio-40fe397c658c523b913252fb0b64867f39e2cb94e5aef7ef216b43e90e288e9b WatchSource:0}: Error finding container 40fe397c658c523b913252fb0b64867f39e2cb94e5aef7ef216b43e90e288e9b: Status 404 returned error can't find the container with id 40fe397c658c523b913252fb0b64867f39e2cb94e5aef7ef216b43e90e288e9b
May 20 15:31:50.653656 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.653643    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 15:31:50.690218 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.690179    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" event={"ID":"09b2b39605c9d5bd54825b8a1b8b3d30","Type":"ContainerStarted","Data":"40fe397c658c523b913252fb0b64867f39e2cb94e5aef7ef216b43e90e288e9b"}
May 20 15:31:50.690993 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.690976    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" event={"ID":"eb002dad605934aeb5aadadf48569211","Type":"ContainerStarted","Data":"97a49388444a4c295dcb005e0b470993347bdec7e5157cc9250fad2dcd94e1a8"}
May 20 15:31:50.736170 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:50.736140    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:50.836701 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:50.836672    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:50.844343 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:50.844289    2551 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 15:31:50.937281 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:50.937261    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:51.038077 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:51.038057    2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-174.ec2.internal\" not found"
May 20 15:31:51.134618 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.134481    2551 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 15:31:51.150964 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.150937    2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal"
May 20 15:31:51.162349 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.162329    2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 15:31:51.164486 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.164462    2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal"
May 20 15:31:51.173362 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.173340    2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 15:31:51.529056 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.528976    2551 apiserver.go:52] "Watching apiserver"
May 20 15:31:51.538250 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.538226    2551 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 20 15:31:51.540717 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.540691    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-wt7qs","openshift-ovn-kubernetes/ovnkube-node-hgrgj","kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t","openshift-dns/node-resolver-wc7k8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal","openshift-multus/multus-9dh62","openshift-multus/multus-additional-cni-plugins-kmslt","openshift-multus/network-metrics-daemon-9mbp7","openshift-network-diagnostics/network-check-target-bwzp6","kube-system/konnectivity-agent-pml9w","openshift-cluster-node-tuning-operator/tuned-bmqwk","openshift-image-registry/node-ca-7t7sn"]
May 20 15:31:51.542182 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.542158    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9dh62"
May 20 15:31:51.543427 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.543403    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.544504 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.544485    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.545514 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.545489    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-45hb8\""
May 20 15:31:51.545899 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.545683    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wc7k8"
May 20 15:31:51.545899 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.545792    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 20 15:31:51.545899 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.545831    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 20 15:31:51.546089 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.546054    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 20 15:31:51.546374 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.546356    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 20 15:31:51.546594 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.546578    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 20 15:31:51.547151 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.547135    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c69dp\""
May 20 15:31:51.547636 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.547619    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 20 15:31:51.547811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.547792    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 20 15:31:51.548030 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.548011    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 20 15:31:51.548273 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.548252    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 20 15:31:51.548384 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.548368    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 20 15:31:51.548456 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.548429    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 20 15:31:51.548698 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.548680    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 20 15:31:51.548977 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.548945    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 20 15:31:51.550217 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.549158    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-llc6r\""
May 20 15:31:51.550217 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.549262    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wt7qs"
May 20 15:31:51.552238 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.552213    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.553733 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.553713    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2bpng\""
May 20 15:31:51.553845 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.553812    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jj6zl\""
May 20 15:31:51.553938 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.553855    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 20 15:31:51.554639 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.554622    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:51.554750 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:51.554698    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:31:51.556181 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.555648    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 20 15:31:51.556181 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.555661    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 20 15:31:51.556181 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.555734    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 20 15:31:51.556181 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.555757    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 20 15:31:51.556181 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.555963    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j9lkd\""
May 20 15:31:51.556181 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.556030    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 20 15:31:51.556181 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.556081    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 20 15:31:51.556181 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.556175    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:31:51.556522 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:51.556238    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:31:51.557332 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.557311    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pml9w"
May 20 15:31:51.557509 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.557493    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.558480 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.558461    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7t7sn"
May 20 15:31:51.560319 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.560299    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 20 15:31:51.560811 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.560789    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-cnibin\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.560903 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.560827    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-var-lib-cni-multus\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.560993 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.560970    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-var-lib-kubelet\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.561092 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561003    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-cni-netd\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.561092 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561055    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-sys-fs\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.561092 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561078    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-systemd-units\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.561281 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561100    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 20 15:31:51.561281 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561130    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-run-systemd\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.561281 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561187    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2767fe33-7ec4-4e11-8a08-193025168637-ovnkube-config\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.561281 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561209    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 20 15:31:51.561281 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561218    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-device-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.561281 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561246    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd991773-41b2-4420-9557-6b85bfff5498-hosts-file\") pod \"node-resolver-wc7k8\" (UID: \"cd991773-41b2-4420-9557-6b85bfff5498\") " pod="openshift-dns/node-resolver-wc7k8"
May 20 15:31:51.561281 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561267    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qks6x\" (UniqueName: \"kubernetes.io/projected/cd991773-41b2-4420-9557-6b85bfff5498-kube-api-access-qks6x\") pod \"node-resolver-wc7k8\" (UID: \"cd991773-41b2-4420-9557-6b85bfff5498\") " pod="openshift-dns/node-resolver-wc7k8"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561286    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-os-release\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561299    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-var-lib-cni-bin\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561315    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-run-netns\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561329    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdnnv\" (UniqueName: \"kubernetes.io/projected/f0f6e707-1c88-43e2-abec-ef705fd106b6-kube-api-access-cdnnv\") pod \"iptables-alerter-wt7qs\" (UID: \"f0f6e707-1c88-43e2-abec-ef705fd106b6\") " pod="openshift-network-operator/iptables-alerter-wt7qs"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561343    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561373    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5258eee-17f0-4591-96e6-a83296a06bc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561389    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5258eee-17f0-4591-96e6-a83296a06bc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561403    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-registration-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561420    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-cnibin\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561435    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-daemon-config\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561450    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-var-lib-openvswitch\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561465    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-node-log\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561506    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561521    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561527    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wsl4c\""
May 20 15:31:51.561615 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561571    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561634    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lbm42\""
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561536    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2767fe33-7ec4-4e11-8a08-193025168637-env-overrides\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561684    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-socket-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561709    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-run-k8s-cni-cncf-io\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561737    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-slash\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561761    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-socket-dir-parent\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561783    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-kubelet\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561803    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0f6e707-1c88-43e2-abec-ef705fd106b6-iptables-alerter-script\") pod \"iptables-alerter-wt7qs\" (UID: \"f0f6e707-1c88-43e2-abec-ef705fd106b6\") " pod="openshift-network-operator/iptables-alerter-wt7qs"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561817    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-os-release\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561847    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-conf-dir\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561874    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2767fe33-7ec4-4e11-8a08-193025168637-ovn-node-metrics-cert\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561900    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwg2m\" (UniqueName: \"kubernetes.io/projected/2767fe33-7ec4-4e11-8a08-193025168637-kube-api-access-qwg2m\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561921    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0f6e707-1c88-43e2-abec-ef705fd106b6-host-slash\") pod \"iptables-alerter-wt7qs\" (UID: \"f0f6e707-1c88-43e2-abec-ef705fd106b6\") " pod="openshift-network-operator/iptables-alerter-wt7qs"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561959    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5258eee-17f0-4591-96e6-a83296a06bc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561973    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-cni-dir\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.561994    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-etc-openvswitch\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.562434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562018    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-log-socket\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562037    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-system-cni-dir\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562050    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-run-ovn\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562072    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f34274a-efed-4d55-8bda-365b7b66fc6b-cni-binary-copy\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562099    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6k7q\" (UniqueName: \"kubernetes.io/projected/5f34274a-efed-4d55-8bda-365b7b66fc6b-kube-api-access-m6k7q\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562151    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562175    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvv5p\" (UniqueName: \"kubernetes.io/projected/70538ab1-b139-4564-a5c9-dfad71a37338-kube-api-access-nvv5p\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562194    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-run-netns\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562222    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-hostroot\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562243    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c6hl\" (UniqueName: \"kubernetes.io/projected/d5258eee-17f0-4591-96e6-a83296a06bc4-kube-api-access-2c6hl\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562278    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd991773-41b2-4420-9557-6b85bfff5498-tmp-dir\") pod \"node-resolver-wc7k8\" (UID: \"cd991773-41b2-4420-9557-6b85bfff5498\") " pod="openshift-dns/node-resolver-wc7k8"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562304    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-run-openvswitch\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562330    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-etc-selinux\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562332    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562362    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-run-multus-certs\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562363    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-45dhx\""
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562391    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562399    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-etc-kubernetes\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.563222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562433    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-cni-bin\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.564074 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562461    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2767fe33-7ec4-4e11-8a08-193025168637-ovnkube-script-lib\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.564074 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562482    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.564074 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.562785    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 20 15:31:51.599077 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.599051    2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 15:26:50 +0000 UTC" deadline="2028-02-19 11:41:11.6063174 +0000 UTC"
May 20 15:31:51.599210 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.599078    2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15356h9m20.007242579s"
May 20 15:31:51.650847 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.650823    2551 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 20 15:31:51.663544 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663522    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-os-release\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.663649 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663551    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-var-lib-cni-bin\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.663649 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663574    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-run-netns\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.663649 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663599    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdnnv\" (UniqueName: \"kubernetes.io/projected/f0f6e707-1c88-43e2-abec-ef705fd106b6-kube-api-access-cdnnv\") pod \"iptables-alerter-wt7qs\" (UID: \"f0f6e707-1c88-43e2-abec-ef705fd106b6\") " pod="openshift-network-operator/iptables-alerter-wt7qs"
May 20 15:31:51.663761 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663653    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-var-lib-cni-bin\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.663761 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663656    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-run-netns\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.663761 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663656    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-os-release\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.663761 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663683    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.663761 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663710    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-system-cni-dir\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.663761 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663727    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5258eee-17f0-4591-96e6-a83296a06bc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.663761 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663747    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5258eee-17f0-4591-96e6-a83296a06bc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663778    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-kubernetes\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663803    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e0280da-8fc3-4c71-8b18-856304351935-tmp\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663830    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-registration-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663854    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76eeec1d-c82a-47cf-bf0c-8ee3df21607f-konnectivity-ca\") pod \"konnectivity-agent-pml9w\" (UID: \"76eeec1d-c82a-47cf-bf0c-8ee3df21607f\") " pod="kube-system/konnectivity-agent-pml9w"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663873    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-run\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663895    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-cnibin\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663897    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-registration-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663918    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-daemon-config\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663944    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-var-lib-openvswitch\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663952    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-cnibin\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663967    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-node-log\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.663991    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664004    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-var-lib-openvswitch\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664016    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664041    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2767fe33-7ec4-4e11-8a08-193025168637-env-overrides\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664050    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664090 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664063    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-node-log\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664068    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-socket-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664080    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664129    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-run-k8s-cni-cncf-io\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664158    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-slash\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664183    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-socket-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664185    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-systemd\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664226    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-socket-dir-parent\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664230    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-run-k8s-cni-cncf-io\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664227    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-slash\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664267    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-kubelet\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664296    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0f6e707-1c88-43e2-abec-ef705fd106b6-iptables-alerter-script\") pod \"iptables-alerter-wt7qs\" (UID: \"f0f6e707-1c88-43e2-abec-ef705fd106b6\") " pod="openshift-network-operator/iptables-alerter-wt7qs"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664324    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-sysctl-conf\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664269    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-socket-dir-parent\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664350    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-lib-modules\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664374    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-os-release\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664381    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-kubelet\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.664807 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664400    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-conf-dir\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664424    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2767fe33-7ec4-4e11-8a08-193025168637-ovn-node-metrics-cert\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664424    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5258eee-17f0-4591-96e6-a83296a06bc4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664446    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2767fe33-7ec4-4e11-8a08-193025168637-env-overrides\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664449    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5258eee-17f0-4591-96e6-a83296a06bc4-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664510    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-conf-dir\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664513    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-daemon-config\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664448    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwg2m\" (UniqueName: \"kubernetes.io/projected/2767fe33-7ec4-4e11-8a08-193025168637-kube-api-access-qwg2m\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664516    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-os-release\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664550    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0f6e707-1c88-43e2-abec-ef705fd106b6-host-slash\") pod \"iptables-alerter-wt7qs\" (UID: \"f0f6e707-1c88-43e2-abec-ef705fd106b6\") " pod="openshift-network-operator/iptables-alerter-wt7qs"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664578    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5258eee-17f0-4591-96e6-a83296a06bc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664602    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-cni-dir\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664626    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-etc-openvswitch\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664638    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0f6e707-1c88-43e2-abec-ef705fd106b6-host-slash\") pod \"iptables-alerter-wt7qs\" (UID: \"f0f6e707-1c88-43e2-abec-ef705fd106b6\") " pod="openshift-network-operator/iptables-alerter-wt7qs"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664650    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-log-socket\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664678    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-sysctl-d\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664703    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e0280da-8fc3-4c71-8b18-856304351935-etc-tuned\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.665487 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664702    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-multus-cni-dir\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664727    2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664733    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-log-socket\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664759    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-system-cni-dir\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664784    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-run-ovn\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664815    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgljr\" (UniqueName: \"kubernetes.io/projected/1788a026-1004-47b0-87a4-192bdb1ecf17-kube-api-access-xgljr\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664824    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-run-ovn\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664832    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-system-cni-dir\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664837    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-sysconfig\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664786    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-etc-openvswitch\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664876    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f34274a-efed-4d55-8bda-365b7b66fc6b-cni-binary-copy\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664902    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6k7q\" (UniqueName: \"kubernetes.io/projected/5f34274a-efed-4d55-8bda-365b7b66fc6b-kube-api-access-m6k7q\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664916    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0f6e707-1c88-43e2-abec-ef705fd106b6-iptables-alerter-script\") pod \"iptables-alerter-wt7qs\" (UID: \"f0f6e707-1c88-43e2-abec-ef705fd106b6\") " pod="openshift-network-operator/iptables-alerter-wt7qs"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664929    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664965    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvv5p\" (UniqueName: \"kubernetes.io/projected/70538ab1-b139-4564-a5c9-dfad71a37338-kube-api-access-nvv5p\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.664983    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-run-netns\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665013    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-hostroot\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665038    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2c6hl\" (UniqueName: \"kubernetes.io/projected/d5258eee-17f0-4591-96e6-a83296a06bc4-kube-api-access-2c6hl\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.666409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665067    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665091    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-var-lib-kubelet\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665134    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ce3d4bd-903a-49be-bb13-86f7c1bad65e-serviceca\") pod \"node-ca-7t7sn\" (UID: \"2ce3d4bd-903a-49be-bb13-86f7c1bad65e\") " pod="openshift-image-registry/node-ca-7t7sn"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665144    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5258eee-17f0-4591-96e6-a83296a06bc4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665158    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd991773-41b2-4420-9557-6b85bfff5498-tmp-dir\") pod \"node-resolver-wc7k8\" (UID: \"cd991773-41b2-4420-9557-6b85bfff5498\") " pod="openshift-dns/node-resolver-wc7k8"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665193    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-run-openvswitch\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665221    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76eeec1d-c82a-47cf-bf0c-8ee3df21607f-agent-certs\") pod \"konnectivity-agent-pml9w\" (UID: \"76eeec1d-c82a-47cf-bf0c-8ee3df21607f\") " pod="kube-system/konnectivity-agent-pml9w"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665244    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665247    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjb5x\" (UniqueName: \"kubernetes.io/projected/9e0280da-8fc3-4c71-8b18-856304351935-kube-api-access-tjb5x\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665280    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96mwr\" (UniqueName: \"kubernetes.io/projected/2ce3d4bd-903a-49be-bb13-86f7c1bad65e-kube-api-access-96mwr\") pod \"node-ca-7t7sn\" (UID: \"2ce3d4bd-903a-49be-bb13-86f7c1bad65e\") " pod="openshift-image-registry/node-ca-7t7sn"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665289    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-run-openvswitch\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665308    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-etc-selinux\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665335    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcnt6\" (UniqueName: \"kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6\") pod \"network-check-target-bwzp6\" (UID: \"1437bb6e-5f4b-4872-b432-854c38303dde\") " pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665360    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-modprobe-d\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665383    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-sys\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665410    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-run-multus-certs\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665429    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd991773-41b2-4420-9557-6b85bfff5498-tmp-dir\") pod \"node-resolver-wc7k8\" (UID: \"cd991773-41b2-4420-9557-6b85bfff5498\") " pod="openshift-dns/node-resolver-wc7k8"
May 20 15:31:51.667173 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665435    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-etc-kubernetes\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665460    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-cni-bin\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665475    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-run-netns\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665494    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2767fe33-7ec4-4e11-8a08-193025168637-ovnkube-script-lib\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665521    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665547    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-cnibin\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665565    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-etc-kubernetes\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665572    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-var-lib-cni-multus\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665597    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-etc-selinux\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665598    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-var-lib-kubelet\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665616    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f34274a-efed-4d55-8bda-365b7b66fc6b-cni-binary-copy\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665617    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-run-multus-certs\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665631    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-var-lib-kubelet\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665634    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-cni-netd\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665662    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-sys-fs\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665666    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-cni-bin\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665678    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-cnibin\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665702    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5258eee-17f0-4591-96e6-a83296a06bc4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.667936 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665524    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-hostroot\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665717    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f34274a-efed-4d55-8bda-365b7b66fc6b-host-var-lib-cni-multus\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665686    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-systemd-units\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665739    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-host-cni-netd\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665754    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-sys-fs\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665756    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-run-systemd\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665781    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-run-systemd\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665781    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2767fe33-7ec4-4e11-8a08-193025168637-systemd-units\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665786    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2767fe33-7ec4-4e11-8a08-193025168637-ovnkube-config\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665815    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-device-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665843    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd991773-41b2-4420-9557-6b85bfff5498-hosts-file\") pod \"node-resolver-wc7k8\" (UID: \"cd991773-41b2-4420-9557-6b85bfff5498\") " pod="openshift-dns/node-resolver-wc7k8"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665866    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qks6x\" (UniqueName: \"kubernetes.io/projected/cd991773-41b2-4420-9557-6b85bfff5498-kube-api-access-qks6x\") pod \"node-resolver-wc7k8\" (UID: \"cd991773-41b2-4420-9557-6b85bfff5498\") " pod="openshift-dns/node-resolver-wc7k8"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665879    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70538ab1-b139-4564-a5c9-dfad71a37338-device-dir\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665894    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-host\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665917    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ce3d4bd-903a-49be-bb13-86f7c1bad65e-host\") pod \"node-ca-7t7sn\" (UID: \"2ce3d4bd-903a-49be-bb13-86f7c1bad65e\") " pod="openshift-image-registry/node-ca-7t7sn"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.665925    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd991773-41b2-4420-9557-6b85bfff5498-hosts-file\") pod \"node-resolver-wc7k8\" (UID: \"cd991773-41b2-4420-9557-6b85bfff5498\") " pod="openshift-dns/node-resolver-wc7k8"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.666127    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2767fe33-7ec4-4e11-8a08-193025168637-ovnkube-script-lib\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.666200    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2767fe33-7ec4-4e11-8a08-193025168637-ovnkube-config\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.668526 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.668450    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2767fe33-7ec4-4e11-8a08-193025168637-ovn-node-metrics-cert\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.677689 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.677668    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6k7q\" (UniqueName: \"kubernetes.io/projected/5f34274a-efed-4d55-8bda-365b7b66fc6b-kube-api-access-m6k7q\") pod \"multus-9dh62\" (UID: \"5f34274a-efed-4d55-8bda-365b7b66fc6b\") " pod="openshift-multus/multus-9dh62"
May 20 15:31:51.677689 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.677681    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwg2m\" (UniqueName: \"kubernetes.io/projected/2767fe33-7ec4-4e11-8a08-193025168637-kube-api-access-qwg2m\") pod \"ovnkube-node-hgrgj\" (UID: \"2767fe33-7ec4-4e11-8a08-193025168637\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.677826 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.677806    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvv5p\" (UniqueName: \"kubernetes.io/projected/70538ab1-b139-4564-a5c9-dfad71a37338-kube-api-access-nvv5p\") pod \"aws-ebs-csi-driver-node-jnf7t\" (UID: \"70538ab1-b139-4564-a5c9-dfad71a37338\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.678369 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.678348    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qks6x\" (UniqueName: \"kubernetes.io/projected/cd991773-41b2-4420-9557-6b85bfff5498-kube-api-access-qks6x\") pod \"node-resolver-wc7k8\" (UID: \"cd991773-41b2-4420-9557-6b85bfff5498\") " pod="openshift-dns/node-resolver-wc7k8"
May 20 15:31:51.679249 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.679229    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c6hl\" (UniqueName: \"kubernetes.io/projected/d5258eee-17f0-4591-96e6-a83296a06bc4-kube-api-access-2c6hl\") pod \"multus-additional-cni-plugins-kmslt\" (UID: \"d5258eee-17f0-4591-96e6-a83296a06bc4\") " pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.679982 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.679963    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdnnv\" (UniqueName: \"kubernetes.io/projected/f0f6e707-1c88-43e2-abec-ef705fd106b6-kube-api-access-cdnnv\") pod \"iptables-alerter-wt7qs\" (UID: \"f0f6e707-1c88-43e2-abec-ef705fd106b6\") " pod="openshift-network-operator/iptables-alerter-wt7qs"
May 20 15:31:51.767185 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767143    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-sysctl-d\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767185 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767172    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e0280da-8fc3-4c71-8b18-856304351935-etc-tuned\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767185 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767190    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgljr\" (UniqueName: \"kubernetes.io/projected/1788a026-1004-47b0-87a4-192bdb1ecf17-kube-api-access-xgljr\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:51.767435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767212    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-sysconfig\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767232    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:51.767435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767251    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-var-lib-kubelet\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767273    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ce3d4bd-903a-49be-bb13-86f7c1bad65e-serviceca\") pod \"node-ca-7t7sn\" (UID: \"2ce3d4bd-903a-49be-bb13-86f7c1bad65e\") " pod="openshift-image-registry/node-ca-7t7sn"
May 20 15:31:51.767435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767296    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-sysconfig\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767312    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-sysctl-d\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767358    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-var-lib-kubelet\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767435 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:51.767344    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:31:51.767435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767395    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76eeec1d-c82a-47cf-bf0c-8ee3df21607f-agent-certs\") pod \"konnectivity-agent-pml9w\" (UID: \"76eeec1d-c82a-47cf-bf0c-8ee3df21607f\") " pod="kube-system/konnectivity-agent-pml9w"
May 20 15:31:51.767435 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767427    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjb5x\" (UniqueName: \"kubernetes.io/projected/9e0280da-8fc3-4c71-8b18-856304351935-kube-api-access-tjb5x\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767456    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-96mwr\" (UniqueName: \"kubernetes.io/projected/2ce3d4bd-903a-49be-bb13-86f7c1bad65e-kube-api-access-96mwr\") pod \"node-ca-7t7sn\" (UID: \"2ce3d4bd-903a-49be-bb13-86f7c1bad65e\") " pod="openshift-image-registry/node-ca-7t7sn"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:51.767486    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs podName:1788a026-1004-47b0-87a4-192bdb1ecf17 nodeName:}" failed. No retries permitted until 2026-05-20 15:31:52.267453645 +0000 UTC m=+3.141455381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs") pod "network-metrics-daemon-9mbp7" (UID: "1788a026-1004-47b0-87a4-192bdb1ecf17") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767519    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcnt6\" (UniqueName: \"kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6\") pod \"network-check-target-bwzp6\" (UID: \"1437bb6e-5f4b-4872-b432-854c38303dde\") " pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767546    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-modprobe-d\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767569    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-sys\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767610    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-host\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767632    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ce3d4bd-903a-49be-bb13-86f7c1bad65e-host\") pod \"node-ca-7t7sn\" (UID: \"2ce3d4bd-903a-49be-bb13-86f7c1bad65e\") " pod="openshift-image-registry/node-ca-7t7sn"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767664    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-kubernetes\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767672    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ce3d4bd-903a-49be-bb13-86f7c1bad65e-serviceca\") pod \"node-ca-7t7sn\" (UID: \"2ce3d4bd-903a-49be-bb13-86f7c1bad65e\") " pod="openshift-image-registry/node-ca-7t7sn"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767689    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e0280da-8fc3-4c71-8b18-856304351935-tmp\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767713    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-sys\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767735    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ce3d4bd-903a-49be-bb13-86f7c1bad65e-host\") pod \"node-ca-7t7sn\" (UID: \"2ce3d4bd-903a-49be-bb13-86f7c1bad65e\") " pod="openshift-image-registry/node-ca-7t7sn"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767756    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76eeec1d-c82a-47cf-bf0c-8ee3df21607f-konnectivity-ca\") pod \"konnectivity-agent-pml9w\" (UID: \"76eeec1d-c82a-47cf-bf0c-8ee3df21607f\") " pod="kube-system/konnectivity-agent-pml9w"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767781    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-run\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767787    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-host\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767810    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-kubernetes\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.767840 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767820    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-systemd\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.768693 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767835    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-run\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.768693 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767849    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-sysctl-conf\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.768693 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767876    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-lib-modules\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.768693 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767812    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-modprobe-d\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.768693 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.767884    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-systemd\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.768693 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.768597    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-lib-modules\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.768693 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.768614    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e0280da-8fc3-4c71-8b18-856304351935-etc-sysctl-conf\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.768693 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.768685    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76eeec1d-c82a-47cf-bf0c-8ee3df21607f-konnectivity-ca\") pod \"konnectivity-agent-pml9w\" (UID: \"76eeec1d-c82a-47cf-bf0c-8ee3df21607f\") " pod="kube-system/konnectivity-agent-pml9w"
May 20 15:31:51.771999 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.771964    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e0280da-8fc3-4c71-8b18-856304351935-etc-tuned\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.772758 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.772736    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76eeec1d-c82a-47cf-bf0c-8ee3df21607f-agent-certs\") pod \"konnectivity-agent-pml9w\" (UID: \"76eeec1d-c82a-47cf-bf0c-8ee3df21607f\") " pod="kube-system/konnectivity-agent-pml9w"
May 20 15:31:51.773388 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.773371    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e0280da-8fc3-4c71-8b18-856304351935-tmp\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.781831 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:51.781783    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:31:51.781831 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:51.781809    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:31:51.781831 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:51.781823    2551 projected.go:194] Error preparing data for projected volume kube-api-access-pcnt6 for pod openshift-network-diagnostics/network-check-target-bwzp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:31:51.781964 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:51.781881    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6 podName:1437bb6e-5f4b-4872-b432-854c38303dde nodeName:}" failed. No retries permitted until 2026-05-20 15:31:52.281862486 +0000 UTC m=+3.155864208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pcnt6" (UniqueName: "kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6") pod "network-check-target-bwzp6" (UID: "1437bb6e-5f4b-4872-b432-854c38303dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:31:51.783674 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.783649    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgljr\" (UniqueName: \"kubernetes.io/projected/1788a026-1004-47b0-87a4-192bdb1ecf17-kube-api-access-xgljr\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:51.784164 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.784141    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjb5x\" (UniqueName: \"kubernetes.io/projected/9e0280da-8fc3-4c71-8b18-856304351935-kube-api-access-tjb5x\") pod \"tuned-bmqwk\" (UID: \"9e0280da-8fc3-4c71-8b18-856304351935\") " pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.784562 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.784544    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96mwr\" (UniqueName: \"kubernetes.io/projected/2ce3d4bd-903a-49be-bb13-86f7c1bad65e-kube-api-access-96mwr\") pod \"node-ca-7t7sn\" (UID: \"2ce3d4bd-903a-49be-bb13-86f7c1bad65e\") " pod="openshift-image-registry/node-ca-7t7sn"
May 20 15:31:51.858813 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.858789    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9dh62"
May 20 15:31:51.865552 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.865532    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:31:51.873237 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.873212    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t"
May 20 15:31:51.878735 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.878717    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wc7k8"
May 20 15:31:51.885245 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.885228    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wt7qs"
May 20 15:31:51.890763 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.890748    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kmslt"
May 20 15:31:51.897332 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.897316    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pml9w"
May 20 15:31:51.903828 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.903806    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bmqwk"
May 20 15:31:51.914288 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:51.914264    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7t7sn"
May 20 15:31:52.050148 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.050069    2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 15:31:52.254813 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:52.254712    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76eeec1d_c82a_47cf_bf0c_8ee3df21607f.slice/crio-c6df12d8e604684770380708e7153d21d60b911b417675a63fbb42e33636d50e WatchSource:0}: Error finding container c6df12d8e604684770380708e7153d21d60b911b417675a63fbb42e33636d50e: Status 404 returned error can't find the container with id c6df12d8e604684770380708e7153d21d60b911b417675a63fbb42e33636d50e
May 20 15:31:52.258567 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:52.258548    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f6e707_1c88_43e2_abec_ef705fd106b6.slice/crio-5f18837673df1a93f726984f9c48b53c710cd7d8a6dcfa7a8584373b6d1a8180 WatchSource:0}: Error finding container 5f18837673df1a93f726984f9c48b53c710cd7d8a6dcfa7a8584373b6d1a8180: Status 404 returned error can't find the container with id 5f18837673df1a93f726984f9c48b53c710cd7d8a6dcfa7a8584373b6d1a8180
May 20 15:31:52.259071 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:52.259051    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2767fe33_7ec4_4e11_8a08_193025168637.slice/crio-da56dc0676fd3e7cfc40fb6db35fae8818bfd5b18be9dc5d934b6fb8e54fa1bc WatchSource:0}: Error finding container da56dc0676fd3e7cfc40fb6db35fae8818bfd5b18be9dc5d934b6fb8e54fa1bc: Status 404 returned error can't find the container with id da56dc0676fd3e7cfc40fb6db35fae8818bfd5b18be9dc5d934b6fb8e54fa1bc
May 20 15:31:52.259869 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:52.259818    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5258eee_17f0_4591_96e6_a83296a06bc4.slice/crio-7936026c0dce4ca9dad7b23d4b79b9ed901155bfda6e8e56771e46c1e0550ccd WatchSource:0}: Error finding container 7936026c0dce4ca9dad7b23d4b79b9ed901155bfda6e8e56771e46c1e0550ccd: Status 404 returned error can't find the container with id 7936026c0dce4ca9dad7b23d4b79b9ed901155bfda6e8e56771e46c1e0550ccd
May 20 15:31:52.261585 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:52.261438    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0280da_8fc3_4c71_8b18_856304351935.slice/crio-2227526499fcbd72e717718984279a008c3e89a479b2acd7e83726a50ae1f22d WatchSource:0}: Error finding container 2227526499fcbd72e717718984279a008c3e89a479b2acd7e83726a50ae1f22d: Status 404 returned error can't find the container with id 2227526499fcbd72e717718984279a008c3e89a479b2acd7e83726a50ae1f22d
May 20 15:31:52.262607 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:52.262515    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f34274a_efed_4d55_8bda_365b7b66fc6b.slice/crio-115659c2bde11328fabdd6c7a83b4d0208ea2ed8030d656e584bfe722ce0fcfa WatchSource:0}: Error finding container 115659c2bde11328fabdd6c7a83b4d0208ea2ed8030d656e584bfe722ce0fcfa: Status 404 returned error can't find the container with id 115659c2bde11328fabdd6c7a83b4d0208ea2ed8030d656e584bfe722ce0fcfa
May 20 15:31:52.263527 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:52.263434    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce3d4bd_903a_49be_bb13_86f7c1bad65e.slice/crio-d94a70facda423a2297e796bfedcf8ba117ca0aae2837a44767d9aa620fbf9c7 WatchSource:0}: Error finding container d94a70facda423a2297e796bfedcf8ba117ca0aae2837a44767d9aa620fbf9c7: Status 404 returned error can't find the container with id d94a70facda423a2297e796bfedcf8ba117ca0aae2837a44767d9aa620fbf9c7
May 20 15:31:52.265299 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:52.265281    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70538ab1_b139_4564_a5c9_dfad71a37338.slice/crio-b7d92e21faefe89a86f195f29d0bfa5ef3edb2974bb5a21fbb85ff4069e74bb6 WatchSource:0}: Error finding container b7d92e21faefe89a86f195f29d0bfa5ef3edb2974bb5a21fbb85ff4069e74bb6: Status 404 returned error can't find the container with id b7d92e21faefe89a86f195f29d0bfa5ef3edb2974bb5a21fbb85ff4069e74bb6
May 20 15:31:52.265946 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:31:52.265923    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd991773_41b2_4420_9557_6b85bfff5498.slice/crio-f648253f320880f964e3006dc1189b1a70d2316ec05a03cb1512c94e2310d173 WatchSource:0}: Error finding container f648253f320880f964e3006dc1189b1a70d2316ec05a03cb1512c94e2310d173: Status 404 returned error can't find the container with id f648253f320880f964e3006dc1189b1a70d2316ec05a03cb1512c94e2310d173
May 20 15:31:52.272632 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.272448    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:52.272632 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:52.272608    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:31:52.272825 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:52.272657    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs podName:1788a026-1004-47b0-87a4-192bdb1ecf17 nodeName:}" failed. No retries permitted until 2026-05-20 15:31:53.272639544 +0000 UTC m=+4.146641266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs") pod "network-metrics-daemon-9mbp7" (UID: "1788a026-1004-47b0-87a4-192bdb1ecf17") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:31:52.373498 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.373336    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcnt6\" (UniqueName: \"kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6\") pod \"network-check-target-bwzp6\" (UID: \"1437bb6e-5f4b-4872-b432-854c38303dde\") " pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:31:52.373498 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:52.373493    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:31:52.373625 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:52.373516    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:31:52.373625 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:52.373530    2551 projected.go:194] Error preparing data for projected volume kube-api-access-pcnt6 for pod openshift-network-diagnostics/network-check-target-bwzp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:31:52.373625 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:52.373585    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6 podName:1437bb6e-5f4b-4872-b432-854c38303dde nodeName:}" failed. No retries permitted until 2026-05-20 15:31:53.373564741 +0000 UTC m=+4.247566471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcnt6" (UniqueName: "kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6") pod "network-check-target-bwzp6" (UID: "1437bb6e-5f4b-4872-b432-854c38303dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:31:52.599636 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.599604    2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 15:26:50 +0000 UTC" deadline="2027-12-01 19:08:12.205842712 +0000 UTC"
May 20 15:31:52.599636 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.599636    2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13443h36m19.606210155s"
May 20 15:31:52.700047 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.700006    2551 generic.go:358] "Generic (PLEG): container finished" podID="09b2b39605c9d5bd54825b8a1b8b3d30" containerID="409a76ad39f7760eac9838bb566928d2c43393e1119abf4b5a0a59ca3f1c7fea" exitCode=0
May 20 15:31:52.700222 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.700090    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" event={"ID":"09b2b39605c9d5bd54825b8a1b8b3d30","Type":"ContainerDied","Data":"409a76ad39f7760eac9838bb566928d2c43393e1119abf4b5a0a59ca3f1c7fea"}
May 20 15:31:52.706211 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.706137    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wc7k8" event={"ID":"cd991773-41b2-4420-9557-6b85bfff5498","Type":"ContainerStarted","Data":"f648253f320880f964e3006dc1189b1a70d2316ec05a03cb1512c94e2310d173"}
May 20 15:31:52.708201 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.708133    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bmqwk" event={"ID":"9e0280da-8fc3-4c71-8b18-856304351935","Type":"ContainerStarted","Data":"2227526499fcbd72e717718984279a008c3e89a479b2acd7e83726a50ae1f22d"}
May 20 15:31:52.710081 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.709998    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmslt" event={"ID":"d5258eee-17f0-4591-96e6-a83296a06bc4","Type":"ContainerStarted","Data":"7936026c0dce4ca9dad7b23d4b79b9ed901155bfda6e8e56771e46c1e0550ccd"}
May 20 15:31:52.715285 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.714808    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" event={"ID":"eb002dad605934aeb5aadadf48569211","Type":"ContainerStarted","Data":"1367e5b37fa1e7b1602ca9c6511ccc6477d5eb256729bec0e76bc7810b01dabd"}
May 20 15:31:52.723774 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.723723    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj" event={"ID":"2767fe33-7ec4-4e11-8a08-193025168637","Type":"ContainerStarted","Data":"da56dc0676fd3e7cfc40fb6db35fae8818bfd5b18be9dc5d934b6fb8e54fa1bc"}
May 20 15:31:52.727728 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.727675    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t" event={"ID":"70538ab1-b139-4564-a5c9-dfad71a37338","Type":"ContainerStarted","Data":"b7d92e21faefe89a86f195f29d0bfa5ef3edb2974bb5a21fbb85ff4069e74bb6"}
May 20 15:31:52.742619 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.742531    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7t7sn" event={"ID":"2ce3d4bd-903a-49be-bb13-86f7c1bad65e","Type":"ContainerStarted","Data":"d94a70facda423a2297e796bfedcf8ba117ca0aae2837a44767d9aa620fbf9c7"}
May 20 15:31:52.748869 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.748807    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9dh62" event={"ID":"5f34274a-efed-4d55-8bda-365b7b66fc6b","Type":"ContainerStarted","Data":"115659c2bde11328fabdd6c7a83b4d0208ea2ed8030d656e584bfe722ce0fcfa"}
May 20 15:31:52.753362 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.753316    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wt7qs" event={"ID":"f0f6e707-1c88-43e2-abec-ef705fd106b6","Type":"ContainerStarted","Data":"5f18837673df1a93f726984f9c48b53c710cd7d8a6dcfa7a8584373b6d1a8180"}
May 20 15:31:52.770845 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:52.770818    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pml9w" event={"ID":"76eeec1d-c82a-47cf-bf0c-8ee3df21607f","Type":"ContainerStarted","Data":"c6df12d8e604684770380708e7153d21d60b911b417675a63fbb42e33636d50e"}
May 20 15:31:53.278979 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:53.278880    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:53.279237 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:53.279049    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:31:53.279237 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:53.279126    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs podName:1788a026-1004-47b0-87a4-192bdb1ecf17 nodeName:}" failed. No retries permitted until 2026-05-20 15:31:55.279089408 +0000 UTC m=+6.153091139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs") pod "network-metrics-daemon-9mbp7" (UID: "1788a026-1004-47b0-87a4-192bdb1ecf17") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:31:53.379464 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:53.379431    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcnt6\" (UniqueName: \"kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6\") pod \"network-check-target-bwzp6\" (UID: \"1437bb6e-5f4b-4872-b432-854c38303dde\") " pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:31:53.379629 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:53.379594    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:31:53.379629 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:53.379611    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:31:53.379629 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:53.379624    2551 projected.go:194] Error preparing data for projected volume kube-api-access-pcnt6 for pod openshift-network-diagnostics/network-check-target-bwzp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:31:53.379779 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:53.379678    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6 podName:1437bb6e-5f4b-4872-b432-854c38303dde nodeName:}" failed. No retries permitted until 2026-05-20 15:31:55.379659817 +0000 UTC m=+6.253661539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcnt6" (UniqueName: "kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6") pod "network-check-target-bwzp6" (UID: "1437bb6e-5f4b-4872-b432-854c38303dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:31:53.688912 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:53.688259    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:53.688912 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:53.688402    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:31:53.688912 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:53.688261    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:31:53.688912 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:53.688804    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:31:53.785593 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:53.785532    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" event={"ID":"09b2b39605c9d5bd54825b8a1b8b3d30","Type":"ContainerStarted","Data":"c6507d3dc8d4cd874743b9ca580ed7bc33522352e34abf4cc6b8e660b8fa314c"}
May 20 15:31:53.818088 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:53.816564    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-174.ec2.internal" podStartSLOduration=2.816547658 podStartE2EDuration="2.816547658s" podCreationTimestamp="2026-05-20 15:31:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:31:53.816380954 +0000 UTC m=+4.690382699" watchObservedRunningTime="2026-05-20 15:31:53.816547658 +0000 UTC m=+4.690549397"
May 20 15:31:53.818088 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:53.817521    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-174.ec2.internal" podStartSLOduration=2.817484299 podStartE2EDuration="2.817484299s" podCreationTimestamp="2026-05-20 15:31:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 15:31:52.740249552 +0000 UTC m=+3.614251294" watchObservedRunningTime="2026-05-20 15:31:53.817484299 +0000 UTC m=+4.691486020"
May 20 15:31:55.293808 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:55.293766    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:55.294317 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:55.293936    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:31:55.294317 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:55.294018    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs podName:1788a026-1004-47b0-87a4-192bdb1ecf17 nodeName:}" failed. No retries permitted until 2026-05-20 15:31:59.293998093 +0000 UTC m=+10.167999817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs") pod "network-metrics-daemon-9mbp7" (UID: "1788a026-1004-47b0-87a4-192bdb1ecf17") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:31:55.394586 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:55.394550    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcnt6\" (UniqueName: \"kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6\") pod \"network-check-target-bwzp6\" (UID: \"1437bb6e-5f4b-4872-b432-854c38303dde\") " pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:31:55.394730 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:55.394710    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:31:55.394771 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:55.394742    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:31:55.394771 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:55.394756    2551 projected.go:194] Error preparing data for projected volume kube-api-access-pcnt6 for pod openshift-network-diagnostics/network-check-target-bwzp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:31:55.394835 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:55.394812    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6 podName:1437bb6e-5f4b-4872-b432-854c38303dde nodeName:}" failed. No retries permitted until 2026-05-20 15:31:59.394793372 +0000 UTC m=+10.268795105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcnt6" (UniqueName: "kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6") pod "network-check-target-bwzp6" (UID: "1437bb6e-5f4b-4872-b432-854c38303dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:31:55.687660 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:55.687626    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:55.687831 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:55.687772    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:31:55.688253 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:55.688200    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:31:55.688347 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:55.688321    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:31:57.688455 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:57.688414    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:31:57.688455 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:57.688447    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:57.688995 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:57.688554    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:31:57.688995 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:57.688683    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:31:59.325897 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:59.325862    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:59.326433 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:59.326012    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:31:59.326433 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:59.326067    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs podName:1788a026-1004-47b0-87a4-192bdb1ecf17 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:07.326051488 +0000 UTC m=+18.200053207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs") pod "network-metrics-daemon-9mbp7" (UID: "1788a026-1004-47b0-87a4-192bdb1ecf17") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:31:59.426932 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:59.426894    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcnt6\" (UniqueName: \"kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6\") pod \"network-check-target-bwzp6\" (UID: \"1437bb6e-5f4b-4872-b432-854c38303dde\") " pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:31:59.427101 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:59.427031    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:31:59.427101 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:59.427050    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:31:59.427101 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:59.427063    2551 projected.go:194] Error preparing data for projected volume kube-api-access-pcnt6 for pod openshift-network-diagnostics/network-check-target-bwzp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:31:59.427274 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:59.427138    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6 podName:1437bb6e-5f4b-4872-b432-854c38303dde nodeName:}" failed. No retries permitted until 2026-05-20 15:32:07.427100148 +0000 UTC m=+18.301101872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcnt6" (UniqueName: "kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6") pod "network-check-target-bwzp6" (UID: "1437bb6e-5f4b-4872-b432-854c38303dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:31:59.689300 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:59.688778    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:31:59.689300 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:59.688894    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:31:59.689300 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:31:59.689207    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:31:59.689300 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:31:59.689268    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:01.687978 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:01.687944    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:01.688498 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:01.687980    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:01.688498 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:01.688078    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:01.688498 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:01.688212    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:03.688365 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:03.688328    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:03.688365 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:03.688354    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:03.688864 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:03.688440    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:03.688864 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:03.688833    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:05.687849 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:05.687804    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:05.687849 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:05.687836    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:05.688308 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:05.687966    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:05.688308 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:05.688169    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:07.390180 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:07.390143    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:07.390652 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:07.390294    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:07.390652 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:07.390355    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs podName:1788a026-1004-47b0-87a4-192bdb1ecf17 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:23.390336504 +0000 UTC m=+34.264338226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs") pod "network-metrics-daemon-9mbp7" (UID: "1788a026-1004-47b0-87a4-192bdb1ecf17") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:07.491488 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:07.491449    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcnt6\" (UniqueName: \"kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6\") pod \"network-check-target-bwzp6\" (UID: \"1437bb6e-5f4b-4872-b432-854c38303dde\") " pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:07.491656 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:07.491589    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:32:07.491656 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:07.491612    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:32:07.491656 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:07.491622    2551 projected.go:194] Error preparing data for projected volume kube-api-access-pcnt6 for pod openshift-network-diagnostics/network-check-target-bwzp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:07.491813 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:07.491685    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6 podName:1437bb6e-5f4b-4872-b432-854c38303dde nodeName:}" failed. No retries permitted until 2026-05-20 15:32:23.491667504 +0000 UTC m=+34.365669226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcnt6" (UniqueName: "kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6") pod "network-check-target-bwzp6" (UID: "1437bb6e-5f4b-4872-b432-854c38303dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:07.688091 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:07.688022    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:07.688242 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:07.688022    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:07.688242 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:07.688142    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:07.688328 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:07.688233    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:09.688779 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:09.688734    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:09.689251 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:09.688836    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:09.689251 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:09.688894    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:09.689251 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:09.689024    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:10.821325 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.821031    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pml9w" event={"ID":"76eeec1d-c82a-47cf-bf0c-8ee3df21607f","Type":"ContainerStarted","Data":"09a086b85f6bc5d0497021ed42bb047afe86af7992050870d0329cfb9e14bfbe"}
May 20 15:32:10.822440 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.822414    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wc7k8" event={"ID":"cd991773-41b2-4420-9557-6b85bfff5498","Type":"ContainerStarted","Data":"9025de35c934677cc7fe7b548a42151732d9a2064160630573a4067abf1ec762"}
May 20 15:32:10.823693 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.823666    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bmqwk" event={"ID":"9e0280da-8fc3-4c71-8b18-856304351935","Type":"ContainerStarted","Data":"3269670b9e53121be33dbeb77d9a37c1062d7cf18991fe05525cbba3449d0bce"}
May 20 15:32:10.825074 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.825049    2551 generic.go:358] "Generic (PLEG): container finished" podID="d5258eee-17f0-4591-96e6-a83296a06bc4" containerID="5a5e90f88c2a52f60cef771e192ed70766a91fbc7f20ee57301fdfe37a3f9329" exitCode=0
May 20 15:32:10.825195 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.825131    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmslt" event={"ID":"d5258eee-17f0-4591-96e6-a83296a06bc4","Type":"ContainerDied","Data":"5a5e90f88c2a52f60cef771e192ed70766a91fbc7f20ee57301fdfe37a3f9329"}
May 20 15:32:10.826607 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.826540    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t" event={"ID":"70538ab1-b139-4564-a5c9-dfad71a37338","Type":"ContainerStarted","Data":"eff88f7fee6b8617da272c87fe2b2fd9fc22ddf15a3cc65f7c9753f8ea2f41b3"}
May 20 15:32:10.827966 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.827937    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7t7sn" event={"ID":"2ce3d4bd-903a-49be-bb13-86f7c1bad65e","Type":"ContainerStarted","Data":"6759669aa55d24b3b7961d4814305fe43bb45d1afd5349bfd501f0f293eb6667"}
May 20 15:32:10.829209 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.829182    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9dh62" event={"ID":"5f34274a-efed-4d55-8bda-365b7b66fc6b","Type":"ContainerStarted","Data":"d97bbbbb86fc786b09603977c95ad9520d6e25f0cff0f00af8058e164fa4b4a9"}
May 20 15:32:10.838349 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.838300    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pml9w" podStartSLOduration=3.822174186 podStartE2EDuration="21.838285011s" podCreationTimestamp="2026-05-20 15:31:49 +0000 UTC" firstStartedPulling="2026-05-20 15:31:52.25767624 +0000 UTC m=+3.131677958" lastFinishedPulling="2026-05-20 15:32:10.273787064 +0000 UTC m=+21.147788783" observedRunningTime="2026-05-20 15:32:10.837462749 +0000 UTC m=+21.711464487" watchObservedRunningTime="2026-05-20 15:32:10.838285011 +0000 UTC m=+21.712286752"
May 20 15:32:10.853470 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.853417    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-wc7k8" podStartSLOduration=3.777223352 podStartE2EDuration="21.853405161s" podCreationTimestamp="2026-05-20 15:31:49 +0000 UTC" firstStartedPulling="2026-05-20 15:31:52.267923814 +0000 UTC m=+3.141925538" lastFinishedPulling="2026-05-20 15:32:10.344105623 +0000 UTC m=+21.218107347" observedRunningTime="2026-05-20 15:32:10.853257707 +0000 UTC m=+21.727259448" watchObservedRunningTime="2026-05-20 15:32:10.853405161 +0000 UTC m=+21.727406902"
May 20 15:32:10.869230 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.869189    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7t7sn" podStartSLOduration=3.861885933 podStartE2EDuration="21.86917368s" podCreationTimestamp="2026-05-20 15:31:49 +0000 UTC" firstStartedPulling="2026-05-20 15:31:52.266467501 +0000 UTC m=+3.140469220" lastFinishedPulling="2026-05-20 15:32:10.273755235 +0000 UTC m=+21.147756967" observedRunningTime="2026-05-20 15:32:10.868581449 +0000 UTC m=+21.742583190" watchObservedRunningTime="2026-05-20 15:32:10.86917368 +0000 UTC m=+21.743175423"
May 20 15:32:10.908019 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.907982    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bmqwk" podStartSLOduration=3.836053098 podStartE2EDuration="21.907970115s" podCreationTimestamp="2026-05-20 15:31:49 +0000 UTC" firstStartedPulling="2026-05-20 15:31:52.263722475 +0000 UTC m=+3.137724195" lastFinishedPulling="2026-05-20 15:32:10.335639479 +0000 UTC m=+21.209641212" observedRunningTime="2026-05-20 15:32:10.907756295 +0000 UTC m=+21.781758035" watchObservedRunningTime="2026-05-20 15:32:10.907970115 +0000 UTC m=+21.781971855"
May 20 15:32:10.924972 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:10.924936    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-9dh62" podStartSLOduration=3.835510324 podStartE2EDuration="21.924923917s" podCreationTimestamp="2026-05-20 15:31:49 +0000 UTC" firstStartedPulling="2026-05-20 15:31:52.263966555 +0000 UTC m=+3.137968275" lastFinishedPulling="2026-05-20 15:32:10.353380145 +0000 UTC m=+21.227381868" observedRunningTime="2026-05-20 15:32:10.924819285 +0000 UTC m=+21.798821025" watchObservedRunningTime="2026-05-20 15:32:10.924923917 +0000 UTC m=+21.798925660"
May 20 15:32:11.687748 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:11.687433    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:11.687748 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:11.687446    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:11.687933 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:11.687874    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:11.688079 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:11.688016    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:11.835081 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:11.834713    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj" event={"ID":"2767fe33-7ec4-4e11-8a08-193025168637","Type":"ContainerStarted","Data":"a599c6a68af133299429ddb8a92c6123f061c4763aa8826c45f2b950b4a17145"}
May 20 15:32:11.835081 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:11.834754    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj" event={"ID":"2767fe33-7ec4-4e11-8a08-193025168637","Type":"ContainerStarted","Data":"a2bec2759ca4c425abff54691fbf9846b771c484accbc6a2cf3fe91b9e9105b5"}
May 20 15:32:11.835081 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:11.834768    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj" event={"ID":"2767fe33-7ec4-4e11-8a08-193025168637","Type":"ContainerStarted","Data":"be9debe52e907b8c560c8d6b0519ba0b144790cdce8c47690957274d784aeae1"}
May 20 15:32:11.918501 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:11.918418    2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 20 15:32:12.618099 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:12.617989    2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T15:32:11.918437375Z","UUID":"87f7c768-e05e-47c5-85c7-27e0c5687538","Handler":null,"Name":"","Endpoint":""}
May 20 15:32:12.620085 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:12.620061    2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 20 15:32:12.620235 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:12.620102    2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 20 15:32:12.840183 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:12.839757    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj" event={"ID":"2767fe33-7ec4-4e11-8a08-193025168637","Type":"ContainerStarted","Data":"4109f2645097e8d2cd9e5e2616d6f20a3d3f9f633038998ce7b160b1b7a18f03"}
May 20 15:32:12.840183 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:12.839799    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj" event={"ID":"2767fe33-7ec4-4e11-8a08-193025168637","Type":"ContainerStarted","Data":"9a8d688a57dfec61950d8f9ab696734d89a709aa16a84183d2358d6ff0f34489"}
May 20 15:32:12.840183 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:12.839815    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj" event={"ID":"2767fe33-7ec4-4e11-8a08-193025168637","Type":"ContainerStarted","Data":"12a035953ea24281ee6affb6f05b758210c597419496895c2b7d0ae1eb5cd29e"}
May 20 15:32:12.842179 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:12.842144    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t" event={"ID":"70538ab1-b139-4564-a5c9-dfad71a37338","Type":"ContainerStarted","Data":"52ce927727528c5c15ad4402347a7821d22b6c87947f69d2456f6322c2533dee"}
May 20 15:32:12.843588 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:12.843558    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wt7qs" event={"ID":"f0f6e707-1c88-43e2-abec-ef705fd106b6","Type":"ContainerStarted","Data":"5d0b85d14bf07740c0d178b770cfeed56e23d1177847710fb4a440b4b6e03b46"}
May 20 15:32:12.862472 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:12.862405    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wt7qs" podStartSLOduration=5.782446279 podStartE2EDuration="23.86238938s" podCreationTimestamp="2026-05-20 15:31:49 +0000 UTC" firstStartedPulling="2026-05-20 15:31:52.260463104 +0000 UTC m=+3.134464838" lastFinishedPulling="2026-05-20 15:32:10.340406215 +0000 UTC m=+21.214407939" observedRunningTime="2026-05-20 15:32:12.861907113 +0000 UTC m=+23.735908853" watchObservedRunningTime="2026-05-20 15:32:12.86238938 +0000 UTC m=+23.736391122"
May 20 15:32:13.688558 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:13.688402    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:13.688558 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:13.688526    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:13.688785 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:13.688591    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:13.688785 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:13.688690    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:13.844630 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:13.844085    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pml9w"
May 20 15:32:13.845206 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:13.845180    2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pml9w"
May 20 15:32:13.847925 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:13.847888    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t" event={"ID":"70538ab1-b139-4564-a5c9-dfad71a37338","Type":"ContainerStarted","Data":"1dcd0b4f5912c52f7724481b03dc6501725243c75c8ceec7ffdcb2b763dd337c"}
May 20 15:32:13.883999 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:13.883961    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnf7t" podStartSLOduration=4.309926183 podStartE2EDuration="24.883949668s" podCreationTimestamp="2026-05-20 15:31:49 +0000 UTC" firstStartedPulling="2026-05-20 15:31:52.267497076 +0000 UTC m=+3.141498797" lastFinishedPulling="2026-05-20 15:32:12.84152055 +0000 UTC m=+23.715522282" observedRunningTime="2026-05-20 15:32:13.883880702 +0000 UTC m=+24.757882445" watchObservedRunningTime="2026-05-20 15:32:13.883949668 +0000 UTC m=+24.757951408"
May 20 15:32:14.849411 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:14.849268    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pml9w"
May 20 15:32:14.849751 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:14.849716    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pml9w"
May 20 15:32:15.688190 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:15.688157    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:15.688340 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:15.688215    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:15.688340 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:15.688297    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:15.688460 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:15.688438    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:15.852079 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:15.852049    2551 generic.go:358] "Generic (PLEG): container finished" podID="d5258eee-17f0-4591-96e6-a83296a06bc4" containerID="53f11ecb6657e94aa195200e1b11ad3f3b79b7341d83d9e5afe087b7bc78bafa" exitCode=0
May 20 15:32:15.852669 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:15.852135    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmslt" event={"ID":"d5258eee-17f0-4591-96e6-a83296a06bc4","Type":"ContainerDied","Data":"53f11ecb6657e94aa195200e1b11ad3f3b79b7341d83d9e5afe087b7bc78bafa"}
May 20 15:32:15.855045 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:15.855027    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj" event={"ID":"2767fe33-7ec4-4e11-8a08-193025168637","Type":"ContainerStarted","Data":"7ea6407f70757f7d43e722259ad3e349ac915c5ffe7d18f714ebab0a4b6a22a3"}
May 20 15:32:16.858829 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:16.858800    2551 generic.go:358] "Generic (PLEG): container finished" podID="d5258eee-17f0-4591-96e6-a83296a06bc4" containerID="7d4ff11ec66110a92f510b64406681e6e38ebea7fdc499778697805894d958ae" exitCode=0
May 20 15:32:16.859204 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:16.858890    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmslt" event={"ID":"d5258eee-17f0-4591-96e6-a83296a06bc4","Type":"ContainerDied","Data":"7d4ff11ec66110a92f510b64406681e6e38ebea7fdc499778697805894d958ae"}
May 20 15:32:17.687563 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:17.687372    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:17.687649 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:17.687432    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:17.687649 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:17.687621    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:17.687717 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:17.687678    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:17.863390 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:17.863359    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj" event={"ID":"2767fe33-7ec4-4e11-8a08-193025168637","Type":"ContainerStarted","Data":"a24d47cf5f055477f34b1a5f23b9d8aa403ecac2b9d50fb07df5e439cb33ad74"}
May 20 15:32:17.863891 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:17.863683    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:32:17.863891 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:17.863702    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:32:17.865535 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:17.865510    2551 generic.go:358] "Generic (PLEG): container finished" podID="d5258eee-17f0-4591-96e6-a83296a06bc4" containerID="51cd7c6ac16eacd879b7c17c476f8ef577d306a31d965a97800baaa64acf8e53" exitCode=0
May 20 15:32:17.865623 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:17.865545    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmslt" event={"ID":"d5258eee-17f0-4591-96e6-a83296a06bc4","Type":"ContainerDied","Data":"51cd7c6ac16eacd879b7c17c476f8ef577d306a31d965a97800baaa64acf8e53"}
May 20 15:32:17.880607 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:17.880585    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:32:17.899027 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:17.898991    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj" podStartSLOduration=9.981831757 podStartE2EDuration="28.898980186s" podCreationTimestamp="2026-05-20 15:31:49 +0000 UTC" firstStartedPulling="2026-05-20 15:31:52.261191341 +0000 UTC m=+3.135193059" lastFinishedPulling="2026-05-20 15:32:11.178339758 +0000 UTC m=+22.052341488" observedRunningTime="2026-05-20 15:32:17.896974079 +0000 UTC m=+28.770975820" watchObservedRunningTime="2026-05-20 15:32:17.898980186 +0000 UTC m=+28.772981954"
May 20 15:32:18.867922 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:18.867897    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:32:18.886018 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:18.885990    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:32:19.689069 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:19.688858    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:19.689069 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:19.688947    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:19.689069 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:19.689000    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:19.689069 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:19.689029    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:19.918725 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:19.918472    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9mbp7"]
May 20 15:32:19.918725 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:19.918582    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:19.919216 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:19.919189    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bwzp6"]
May 20 15:32:19.919296 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:19.919278    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:19.919403 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:19.919285    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:19.919403 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:19.919373    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:21.688193 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:21.688157    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:21.688582 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:21.688286    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bwzp6" podUID="1437bb6e-5f4b-4872-b432-854c38303dde"
May 20 15:32:21.688582 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:21.688344    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:21.688582 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:21.688470    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:32:23.417157 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.416827    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:23.417157 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:23.416974    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:23.417638 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:23.417225    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs podName:1788a026-1004-47b0-87a4-192bdb1ecf17 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:55.417208268 +0000 UTC m=+66.291209987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs") pod "network-metrics-daemon-9mbp7" (UID: "1788a026-1004-47b0-87a4-192bdb1ecf17") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 15:32:23.458469 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.458443    2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-174.ec2.internal" event="NodeReady"
May 20 15:32:23.458597 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.458553    2551 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 20 15:32:23.512830 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.512799    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xj6h5"]
May 20 15:32:23.518242 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.518220    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcnt6\" (UniqueName: \"kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6\") pod \"network-check-target-bwzp6\" (UID: \"1437bb6e-5f4b-4872-b432-854c38303dde\") " pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:23.518356 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:23.518332    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 15:32:23.518356 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:23.518343    2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 15:32:23.518356 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:23.518352    2551 projected.go:194] Error preparing data for projected volume kube-api-access-pcnt6 for pod openshift-network-diagnostics/network-check-target-bwzp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:23.518454 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:23.518394    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6 podName:1437bb6e-5f4b-4872-b432-854c38303dde nodeName:}" failed. No retries permitted until 2026-05-20 15:32:55.518382986 +0000 UTC m=+66.392384705 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcnt6" (UniqueName: "kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6") pod "network-check-target-bwzp6" (UID: "1437bb6e-5f4b-4872-b432-854c38303dde") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 15:32:23.530040 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.530017    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rz5m6"]
May 20 15:32:23.530194 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.530178    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.533021 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.532999    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-trd7m\""
May 20 15:32:23.533186 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.533025    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 20 15:32:23.533186 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.533004    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 20 15:32:23.542427 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.542409    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xj6h5"]
May 20 15:32:23.542522 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.542431    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rz5m6"]
May 20 15:32:23.542583 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.542536    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:23.545375 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.545356    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 20 15:32:23.545476 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.545375    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 20 15:32:23.545476 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.545405    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 20 15:32:23.545476 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.545357    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4srs2\""
May 20 15:32:23.619209 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.619177    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp62r\" (UniqueName: \"kubernetes.io/projected/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-kube-api-access-hp62r\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.619345 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.619238    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.619345 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.619256    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-tmp-dir\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.619345 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.619275    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-config-volume\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.688253 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.688175    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:23.688253 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.688201    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:23.691350 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.691329    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 15:32:23.691350 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.691349    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 15:32:23.691515 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.691370    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pq86x\""
May 20 15:32:23.691515 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.691418    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sz56g\""
May 20 15:32:23.691688 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.691671    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 15:32:23.719803 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.719783    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:23.719888 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.719818    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.719888 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.719836    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-tmp-dir\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.719888 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.719853    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-config-volume\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.719987 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.719911    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv92m\" (UniqueName: \"kubernetes.io/projected/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-kube-api-access-pv92m\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:23.719987 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:23.719930    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:32:23.719987 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.719953    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hp62r\" (UniqueName: \"kubernetes.io/projected/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-kube-api-access-hp62r\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.719987 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:23.719976    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls podName:8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:24.219960321 +0000 UTC m=+35.093962045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls") pod "dns-default-xj6h5" (UID: "8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0") : secret "dns-default-metrics-tls" not found
May 20 15:32:23.720201 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.720184    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-tmp-dir\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.720348 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.720335    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-config-volume\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.735611 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.735576    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp62r\" (UniqueName: \"kubernetes.io/projected/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-kube-api-access-hp62r\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:23.820557 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.820522    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pv92m\" (UniqueName: \"kubernetes.io/projected/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-kube-api-access-pv92m\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:23.820685 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.820593    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:23.820729 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:23.820696    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:32:23.820762 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:23.820752    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert podName:5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:24.320737935 +0000 UTC m=+35.194739653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert") pod "ingress-canary-rz5m6" (UID: "5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8") : secret "canary-serving-cert" not found
May 20 15:32:23.831592 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.831561    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv92m\" (UniqueName: \"kubernetes.io/projected/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-kube-api-access-pv92m\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:23.879310 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:23.879274    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmslt" event={"ID":"d5258eee-17f0-4591-96e6-a83296a06bc4","Type":"ContainerStarted","Data":"1d011f539d02776a099c9c2d57f767c05d2a95c98239451ab8386e2f20a1deb5"}
May 20 15:32:24.223054 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:24.222974    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:24.223197 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:24.223127    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:32:24.223197 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:24.223187    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls podName:8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:25.223170064 +0000 UTC m=+36.097171782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls") pod "dns-default-xj6h5" (UID: "8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0") : secret "dns-default-metrics-tls" not found
May 20 15:32:24.323966 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:24.323941    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:24.324089 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:24.324073    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:32:24.324161 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:24.324145    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert podName:5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:25.324129416 +0000 UTC m=+36.198131147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert") pod "ingress-canary-rz5m6" (UID: "5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8") : secret "canary-serving-cert" not found
May 20 15:32:24.884378 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:24.884340    2551 generic.go:358] "Generic (PLEG): container finished" podID="d5258eee-17f0-4591-96e6-a83296a06bc4" containerID="1d011f539d02776a099c9c2d57f767c05d2a95c98239451ab8386e2f20a1deb5" exitCode=0
May 20 15:32:24.885012 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:24.884382    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmslt" event={"ID":"d5258eee-17f0-4591-96e6-a83296a06bc4","Type":"ContainerDied","Data":"1d011f539d02776a099c9c2d57f767c05d2a95c98239451ab8386e2f20a1deb5"}
May 20 15:32:25.229945 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:25.229886    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:25.230056 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:25.230035    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:32:25.230126 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:25.230100    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls podName:8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:27.230083328 +0000 UTC m=+38.104085053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls") pod "dns-default-xj6h5" (UID: "8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0") : secret "dns-default-metrics-tls" not found
May 20 15:32:25.331174 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:25.331149    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:25.331291 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:25.331275    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:32:25.331336 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:25.331327    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert podName:5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:27.331312222 +0000 UTC m=+38.205313947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert") pod "ingress-canary-rz5m6" (UID: "5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8") : secret "canary-serving-cert" not found
May 20 15:32:25.889455 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:25.889412    2551 generic.go:358] "Generic (PLEG): container finished" podID="d5258eee-17f0-4591-96e6-a83296a06bc4" containerID="966416a776ab8c9df23619089e41f1e31070e793b63c129bd200615d7dddc4d2" exitCode=0
May 20 15:32:25.889797 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:25.889494    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmslt" event={"ID":"d5258eee-17f0-4591-96e6-a83296a06bc4","Type":"ContainerDied","Data":"966416a776ab8c9df23619089e41f1e31070e793b63c129bd200615d7dddc4d2"}
May 20 15:32:26.894012 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:26.893978    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmslt" event={"ID":"d5258eee-17f0-4591-96e6-a83296a06bc4","Type":"ContainerStarted","Data":"8cedd7c72b4bcadfb65c3c9a90d58d77d616b8a3691bb00f9b293a27b265583f"}
May 20 15:32:26.920190 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:26.920146    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kmslt" podStartSLOduration=6.472135148 podStartE2EDuration="37.92013359s" podCreationTimestamp="2026-05-20 15:31:49 +0000 UTC" firstStartedPulling="2026-05-20 15:31:52.262813228 +0000 UTC m=+3.136814952" lastFinishedPulling="2026-05-20 15:32:23.710811662 +0000 UTC m=+34.584813394" observedRunningTime="2026-05-20 15:32:26.918508192 +0000 UTC m=+37.792509934" watchObservedRunningTime="2026-05-20 15:32:26.92013359 +0000 UTC m=+37.794135331"
May 20 15:32:27.243984 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:27.243918    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:27.244102 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:27.244010    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:32:27.244102 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:27.244067    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls podName:8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:31.244053264 +0000 UTC m=+42.118054983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls") pod "dns-default-xj6h5" (UID: "8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0") : secret "dns-default-metrics-tls" not found
May 20 15:32:27.344563 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:27.344537    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:27.344664 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:27.344616    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:32:27.344723 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:27.344677    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert podName:5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:31.344665416 +0000 UTC m=+42.218667135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert") pod "ingress-canary-rz5m6" (UID: "5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8") : secret "canary-serving-cert" not found
May 20 15:32:31.269866 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:31.269825    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:31.270275 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:31.269936    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:32:31.270275 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:31.270026    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls podName:8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:39.270011423 +0000 UTC m=+50.144013142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls") pod "dns-default-xj6h5" (UID: "8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0") : secret "dns-default-metrics-tls" not found
May 20 15:32:31.370239 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:31.370207    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:31.370381 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:31.370307    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:32:31.370381 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:31.370364    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert podName:5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:39.370350605 +0000 UTC m=+50.244352324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert") pod "ingress-canary-rz5m6" (UID: "5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8") : secret "canary-serving-cert" not found
May 20 15:32:39.321797 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:39.321751    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:39.322326 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:39.321904    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:32:39.322326 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:39.321985    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls podName:8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:55.321967053 +0000 UTC m=+66.195968777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls") pod "dns-default-xj6h5" (UID: "8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0") : secret "dns-default-metrics-tls" not found
May 20 15:32:39.422995 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:39.422967    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:39.423173 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:39.423150    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:32:39.423253 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:39.423230    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert podName:5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8 nodeName:}" failed. No retries permitted until 2026-05-20 15:32:55.423207327 +0000 UTC m=+66.297209102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert") pod "ingress-canary-rz5m6" (UID: "5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8") : secret "canary-serving-cert" not found
May 20 15:32:41.061552 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.061508    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"]
May 20 15:32:41.105603 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.105568    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"]
May 20 15:32:41.105748 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.105614    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:41.109309 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.109280    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 20 15:32:41.109442 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.109283    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 20 15:32:41.109577 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.109553    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 20 15:32:41.109656 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.109599    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 20 15:32:41.119154 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.119132    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"]
May 20 15:32:41.119154 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.119156    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"]
May 20 15:32:41.119283 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.119203    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.139448 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.139430    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 20 15:32:41.139545 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.139430    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 20 15:32:41.139630 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.139614    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 20 15:32:41.139678 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.139643    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 20 15:32:41.235375 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.235347    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-ca\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.235486 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.235381    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ng2x\" (UniqueName: \"kubernetes.io/projected/4dc526f1-d106-444b-b59d-3c029198357b-kube-api-access-4ng2x\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.235486 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.235413    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daed1787-c9b5-4282-bbdf-5a28ef6b2676-tmp\") pod \"klusterlet-addon-workmgr-79d94bc5c8-sxdgw\" (UID: \"daed1787-c9b5-4282-bbdf-5a28ef6b2676\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:41.235486 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.235462    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-hub\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.235648 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.235485    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwvmh\" (UniqueName: \"kubernetes.io/projected/daed1787-c9b5-4282-bbdf-5a28ef6b2676-kube-api-access-pwvmh\") pod \"klusterlet-addon-workmgr-79d94bc5c8-sxdgw\" (UID: \"daed1787-c9b5-4282-bbdf-5a28ef6b2676\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:41.235648 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.235527    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4dc526f1-d106-444b-b59d-3c029198357b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.235648 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.235562    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.235648 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.235593    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.235648 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.235619    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/daed1787-c9b5-4282-bbdf-5a28ef6b2676-klusterlet-config\") pod \"klusterlet-addon-workmgr-79d94bc5c8-sxdgw\" (UID: \"daed1787-c9b5-4282-bbdf-5a28ef6b2676\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:41.336834 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.336784    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daed1787-c9b5-4282-bbdf-5a28ef6b2676-tmp\") pod \"klusterlet-addon-workmgr-79d94bc5c8-sxdgw\" (UID: \"daed1787-c9b5-4282-bbdf-5a28ef6b2676\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:41.336834 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.336817    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-hub\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.336973 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.336836    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwvmh\" (UniqueName: \"kubernetes.io/projected/daed1787-c9b5-4282-bbdf-5a28ef6b2676-kube-api-access-pwvmh\") pod \"klusterlet-addon-workmgr-79d94bc5c8-sxdgw\" (UID: \"daed1787-c9b5-4282-bbdf-5a28ef6b2676\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:41.337027 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.336977    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4dc526f1-d106-444b-b59d-3c029198357b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.337027 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.337017    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.337147 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.337049    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.337147 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.337083    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/daed1787-c9b5-4282-bbdf-5a28ef6b2676-klusterlet-config\") pod \"klusterlet-addon-workmgr-79d94bc5c8-sxdgw\" (UID: \"daed1787-c9b5-4282-bbdf-5a28ef6b2676\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:41.337260 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.337162    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/daed1787-c9b5-4282-bbdf-5a28ef6b2676-tmp\") pod \"klusterlet-addon-workmgr-79d94bc5c8-sxdgw\" (UID: \"daed1787-c9b5-4282-bbdf-5a28ef6b2676\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:41.337260 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.337187    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-ca\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.337260 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.337216    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ng2x\" (UniqueName: \"kubernetes.io/projected/4dc526f1-d106-444b-b59d-3c029198357b-kube-api-access-4ng2x\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.337949 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.337927    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4dc526f1-d106-444b-b59d-3c029198357b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.340540 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.340510    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.340675 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.340653    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/daed1787-c9b5-4282-bbdf-5a28ef6b2676-klusterlet-config\") pod \"klusterlet-addon-workmgr-79d94bc5c8-sxdgw\" (UID: \"daed1787-c9b5-4282-bbdf-5a28ef6b2676\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:41.341030 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.341002    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-hub\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.344398 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.344376    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-ca\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.344652 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.344631    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4dc526f1-d106-444b-b59d-3c029198357b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.345579 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.345557    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwvmh\" (UniqueName: \"kubernetes.io/projected/daed1787-c9b5-4282-bbdf-5a28ef6b2676-kube-api-access-pwvmh\") pod \"klusterlet-addon-workmgr-79d94bc5c8-sxdgw\" (UID: \"daed1787-c9b5-4282-bbdf-5a28ef6b2676\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:41.346354 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.346335    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ng2x\" (UniqueName: \"kubernetes.io/projected/4dc526f1-d106-444b-b59d-3c029198357b-kube-api-access-4ng2x\") pod \"cluster-proxy-proxy-agent-d7849b4c-r6z6f\" (UID: \"4dc526f1-d106-444b-b59d-3c029198357b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.415397 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.415375    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:41.435466 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.435437    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:32:41.590999 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.590967    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"]
May 20 15:32:41.594739 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:32:41.594708    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dc526f1_d106_444b_b59d_3c029198357b.slice/crio-109dd62a058f49e4b240ba27f9dea84572119132acf694b96ad95b5160ddbb6d WatchSource:0}: Error finding container 109dd62a058f49e4b240ba27f9dea84572119132acf694b96ad95b5160ddbb6d: Status 404 returned error can't find the container with id 109dd62a058f49e4b240ba27f9dea84572119132acf694b96ad95b5160ddbb6d
May 20 15:32:41.601852 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.601830    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"]
May 20 15:32:41.604317 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:32:41.604297    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaed1787_c9b5_4282_bbdf_5a28ef6b2676.slice/crio-fb6f4bbb9d949db06ceed06eef84e8dc1826377feb60dad25eb1e1d35a583fd0 WatchSource:0}: Error finding container fb6f4bbb9d949db06ceed06eef84e8dc1826377feb60dad25eb1e1d35a583fd0: Status 404 returned error can't find the container with id fb6f4bbb9d949db06ceed06eef84e8dc1826377feb60dad25eb1e1d35a583fd0
May 20 15:32:41.921842 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.921766    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" event={"ID":"4dc526f1-d106-444b-b59d-3c029198357b","Type":"ContainerStarted","Data":"109dd62a058f49e4b240ba27f9dea84572119132acf694b96ad95b5160ddbb6d"}
May 20 15:32:41.922712 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:41.922690    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw" event={"ID":"daed1787-c9b5-4282-bbdf-5a28ef6b2676","Type":"ContainerStarted","Data":"fb6f4bbb9d949db06ceed06eef84e8dc1826377feb60dad25eb1e1d35a583fd0"}
May 20 15:32:46.933793 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:46.933706    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw" event={"ID":"daed1787-c9b5-4282-bbdf-5a28ef6b2676","Type":"ContainerStarted","Data":"b1b0f0991ded446475c9b8f31dde9fa92ab9739cbe6f054b9f92986ecc28ad36"}
May 20 15:32:46.934211 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:46.933956    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:46.935033 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:46.935005    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" event={"ID":"4dc526f1-d106-444b-b59d-3c029198357b","Type":"ContainerStarted","Data":"4741e32f5278195594c7492edb7530e4996659a11ed78565db6ed950ec2e09c3"}
May 20 15:32:46.935302 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:46.935286    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw"
May 20 15:32:46.952245 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:46.952207    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79d94bc5c8-sxdgw" podStartSLOduration=0.877731682 podStartE2EDuration="5.952194633s" podCreationTimestamp="2026-05-20 15:32:41 +0000 UTC" firstStartedPulling="2026-05-20 15:32:41.605926358 +0000 UTC m=+52.479928080" lastFinishedPulling="2026-05-20 15:32:46.680389298 +0000 UTC m=+57.554391031" observedRunningTime="2026-05-20 15:32:46.951879481 +0000 UTC m=+57.825881223" watchObservedRunningTime="2026-05-20 15:32:46.952194633 +0000 UTC m=+57.826196365"
May 20 15:32:49.943294 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:49.943218    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" event={"ID":"4dc526f1-d106-444b-b59d-3c029198357b","Type":"ContainerStarted","Data":"ccb330cf77ee2396c6d88db7b65e07a83585e7cb9a32d032aa961baa47864d0b"}
May 20 15:32:49.943294 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:49.943254    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" event={"ID":"4dc526f1-d106-444b-b59d-3c029198357b","Type":"ContainerStarted","Data":"3298b1810b52da9c6ff37e9e11ec49392e903d17b67b9a30f78c97446d14fd83"}
May 20 15:32:50.882408 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:50.882372    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgrgj"
May 20 15:32:50.911495 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:50.911454    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" podStartSLOduration=1.893153865 podStartE2EDuration="9.91143968s" podCreationTimestamp="2026-05-20 15:32:41 +0000 UTC" firstStartedPulling="2026-05-20 15:32:41.596339191 +0000 UTC m=+52.470340909" lastFinishedPulling="2026-05-20 15:32:49.614625006 +0000 UTC m=+60.488626724" observedRunningTime="2026-05-20 15:32:49.964648553 +0000 UTC m=+60.838650295" watchObservedRunningTime="2026-05-20 15:32:50.91143968 +0000 UTC m=+61.785441422"
May 20 15:32:55.330093 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.330060    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:32:55.330462 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:55.330201    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:32:55.330462 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:55.330272    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls podName:8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:27.330255895 +0000 UTC m=+98.204257614 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls") pod "dns-default-xj6h5" (UID: "8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0") : secret "dns-default-metrics-tls" not found
May 20 15:32:55.430939 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.430908    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:32:55.431054 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.430955    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:32:55.431054 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:55.431036    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:32:55.431142 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:55.431093    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert podName:5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:27.431077198 +0000 UTC m=+98.305078919 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert") pod "ingress-canary-rz5m6" (UID: "5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8") : secret "canary-serving-cert" not found
May 20 15:32:55.434154 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.434137    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 15:32:55.441947 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:55.441933    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 15:32:55.441990 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:32:55.441974    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs podName:1788a026-1004-47b0-87a4-192bdb1ecf17 nodeName:}" failed. No retries permitted until 2026-05-20 15:33:59.441963061 +0000 UTC m=+130.315964779 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs") pod "network-metrics-daemon-9mbp7" (UID: "1788a026-1004-47b0-87a4-192bdb1ecf17") : secret "metrics-daemon-secret" not found
May 20 15:32:55.531964 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.531941    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcnt6\" (UniqueName: \"kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6\") pod \"network-check-target-bwzp6\" (UID: \"1437bb6e-5f4b-4872-b432-854c38303dde\") " pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:55.535315 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.535300    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 15:32:55.546052 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.546032    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 15:32:55.556316 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.556289    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcnt6\" (UniqueName: \"kubernetes.io/projected/1437bb6e-5f4b-4872-b432-854c38303dde-kube-api-access-pcnt6\") pod \"network-check-target-bwzp6\" (UID: \"1437bb6e-5f4b-4872-b432-854c38303dde\") " pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:55.806753 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.806728    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pq86x\""
May 20 15:32:55.814189 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.814171    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:55.946471 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.946438    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bwzp6"]
May 20 15:32:55.949440 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:32:55.949412    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1437bb6e_5f4b_4872_b432_854c38303dde.slice/crio-c13ee81886f85ff0ebba12026a5e2616f5c970119556235d55216184874fb84e WatchSource:0}: Error finding container c13ee81886f85ff0ebba12026a5e2616f5c970119556235d55216184874fb84e: Status 404 returned error can't find the container with id c13ee81886f85ff0ebba12026a5e2616f5c970119556235d55216184874fb84e
May 20 15:32:55.955076 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:55.955052    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bwzp6" event={"ID":"1437bb6e-5f4b-4872-b432-854c38303dde","Type":"ContainerStarted","Data":"c13ee81886f85ff0ebba12026a5e2616f5c970119556235d55216184874fb84e"}
May 20 15:32:58.961998 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:58.961962    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bwzp6" event={"ID":"1437bb6e-5f4b-4872-b432-854c38303dde","Type":"ContainerStarted","Data":"2920b011dc7bc01c9a9c00b6f3de008d5ad24a3e641b7228ca89ce3954b24f45"}
May 20 15:32:58.962317 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:58.962132    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:32:58.984080 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:32:58.984040    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bwzp6" podStartSLOduration=67.351756717 podStartE2EDuration="1m9.984028278s" podCreationTimestamp="2026-05-20 15:31:49 +0000 UTC" firstStartedPulling="2026-05-20 15:32:55.951190093 +0000 UTC m=+66.825191813" lastFinishedPulling="2026-05-20 15:32:58.583461652 +0000 UTC m=+69.457463374" observedRunningTime="2026-05-20 15:32:58.983037625 +0000 UTC m=+69.857039367" watchObservedRunningTime="2026-05-20 15:32:58.984028278 +0000 UTC m=+69.858030062"
May 20 15:33:27.343462 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:33:27.343418    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:33:27.343930 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:33:27.343563    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 15:33:27.343930 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:33:27.343638    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls podName:8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:31.343620453 +0000 UTC m=+162.217622171 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls") pod "dns-default-xj6h5" (UID: "8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0") : secret "dns-default-metrics-tls" not found
May 20 15:33:27.444103 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:33:27.444068    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:33:27.444228 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:33:27.444209    2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 15:33:27.444288 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:33:27.444278    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert podName:5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8 nodeName:}" failed. No retries permitted until 2026-05-20 15:34:31.444263603 +0000 UTC m=+162.318265322 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert") pod "ingress-canary-rz5m6" (UID: "5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8") : secret "canary-serving-cert" not found
May 20 15:33:29.965899 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:33:29.965867    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bwzp6"
May 20 15:33:59.446420 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:33:59.446381    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:33:59.446925 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:33:59.446500    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 15:33:59.446925 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:33:59.446573    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs podName:1788a026-1004-47b0-87a4-192bdb1ecf17 nodeName:}" failed. No retries permitted until 2026-05-20 15:36:01.446556646 +0000 UTC m=+252.320558364 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs") pod "network-metrics-daemon-9mbp7" (UID: "1788a026-1004-47b0-87a4-192bdb1ecf17") : secret "metrics-daemon-secret" not found
May 20 15:34:09.776238 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:09.776207    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wc7k8_cd991773-41b2-4420-9557-6b85bfff5498/dns-node-resolver/0.log"
May 20 15:34:10.376207 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:10.376176    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7t7sn_2ce3d4bd-903a-49be-bb13-86f7c1bad65e/node-ca/0.log"
May 20 15:34:26.540310 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:34:26.540258    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xj6h5" podUID="8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0"
May 20 15:34:26.550393 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:34:26.550362    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-rz5m6" podUID="5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8"
May 20 15:34:26.698331 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:34:26.698295    2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9mbp7" podUID="1788a026-1004-47b0-87a4-192bdb1ecf17"
May 20 15:34:27.130088 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:27.130060    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xj6h5"
May 20 15:34:31.362631 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:31.362593    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:34:31.365233 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:31.365207    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0-metrics-tls\") pod \"dns-default-xj6h5\" (UID: \"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0\") " pod="openshift-dns/dns-default-xj6h5"
May 20 15:34:31.463020 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:31.462991    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:34:31.465308 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:31.465290    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8-cert\") pod \"ingress-canary-rz5m6\" (UID: \"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8\") " pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:34:31.634197 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:31.634136    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-trd7m\""
May 20 15:34:31.641720 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:31.641704    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xj6h5"
May 20 15:34:31.771218 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:31.771188    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xj6h5"]
May 20 15:34:31.773423 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:34:31.773375    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb1fdfa_7abf_438d_9ffa_ac0a3906e0d0.slice/crio-b051018bf5538b2297ca843f83b51535f4e68521c539e216005b040e4c790e03 WatchSource:0}: Error finding container b051018bf5538b2297ca843f83b51535f4e68521c539e216005b040e4c790e03: Status 404 returned error can't find the container with id b051018bf5538b2297ca843f83b51535f4e68521c539e216005b040e4c790e03
May 20 15:34:32.141071 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:32.141043    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xj6h5" event={"ID":"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0","Type":"ContainerStarted","Data":"b051018bf5538b2297ca843f83b51535f4e68521c539e216005b040e4c790e03"}
May 20 15:34:34.149194 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:34.149144    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xj6h5" event={"ID":"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0","Type":"ContainerStarted","Data":"11b2155d4c6530ff6adcb03be8352f9769a21a2745625efc9ef03288d1165ab8"}
May 20 15:34:34.149194 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:34.149195    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xj6h5" event={"ID":"8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0","Type":"ContainerStarted","Data":"cf3e2eb411e01fcf487f0d33f82983c39a6d24dd8ebeef912acd5c8ca58dfd27"}
May 20 15:34:34.149718 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:34.149343    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xj6h5"
May 20 15:34:34.170877 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:34.170821    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-xj6h5" podStartSLOduration=129.865936489 podStartE2EDuration="2m11.170806395s" podCreationTimestamp="2026-05-20 15:32:23 +0000 UTC" firstStartedPulling="2026-05-20 15:34:31.774714881 +0000 UTC m=+162.648716601" lastFinishedPulling="2026-05-20 15:34:33.079584784 +0000 UTC m=+163.953586507" observedRunningTime="2026-05-20 15:34:34.169213519 +0000 UTC m=+165.043215260" watchObservedRunningTime="2026-05-20 15:34:34.170806395 +0000 UTC m=+165.044808135"
May 20 15:34:35.794999 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.794971    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6jm9g"]
May 20 15:34:35.796837 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.796822    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.800089 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.800068    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 20 15:34:35.801661 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.801637    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s94kz\""
May 20 15:34:35.801772 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.801676    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 20 15:34:35.801772 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.801637    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 20 15:34:35.801772 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.801749    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 20 15:34:35.812570 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.812548    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jm9g"]
May 20 15:34:35.894735 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.894713    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03f6c581-31ad-405b-a11c-5c6f9a77c10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.894832 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.894742    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03f6c581-31ad-405b-a11c-5c6f9a77c10a-crio-socket\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.894832 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.894771    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03f6c581-31ad-405b-a11c-5c6f9a77c10a-data-volume\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.894832 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.894788    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2ndz\" (UniqueName: \"kubernetes.io/projected/03f6c581-31ad-405b-a11c-5c6f9a77c10a-kube-api-access-k2ndz\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.894933 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.894869    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03f6c581-31ad-405b-a11c-5c6f9a77c10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.995152 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.995130    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03f6c581-31ad-405b-a11c-5c6f9a77c10a-data-volume\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.995268 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.995160    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2ndz\" (UniqueName: \"kubernetes.io/projected/03f6c581-31ad-405b-a11c-5c6f9a77c10a-kube-api-access-k2ndz\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.995268 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.995185    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03f6c581-31ad-405b-a11c-5c6f9a77c10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.995268 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.995215    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03f6c581-31ad-405b-a11c-5c6f9a77c10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.995268 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.995237    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03f6c581-31ad-405b-a11c-5c6f9a77c10a-crio-socket\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.995420 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.995309    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03f6c581-31ad-405b-a11c-5c6f9a77c10a-crio-socket\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.995486 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.995468    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03f6c581-31ad-405b-a11c-5c6f9a77c10a-data-volume\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.995698 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.995681    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03f6c581-31ad-405b-a11c-5c6f9a77c10a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:35.997604 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:35.997586    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03f6c581-31ad-405b-a11c-5c6f9a77c10a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:36.007731 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:36.007708    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2ndz\" (UniqueName: \"kubernetes.io/projected/03f6c581-31ad-405b-a11c-5c6f9a77c10a-kube-api-access-k2ndz\") pod \"insights-runtime-extractor-6jm9g\" (UID: \"03f6c581-31ad-405b-a11c-5c6f9a77c10a\") " pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:36.105787 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:36.105767    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jm9g"
May 20 15:34:36.229089 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:36.229064    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jm9g"]
May 20 15:34:36.232402 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:34:36.232374    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f6c581_31ad_405b_a11c_5c6f9a77c10a.slice/crio-5f6fca90e6e700fd0cd4496c1cf4dba04284a0fe483c330bf363d41f08f071f0 WatchSource:0}: Error finding container 5f6fca90e6e700fd0cd4496c1cf4dba04284a0fe483c330bf363d41f08f071f0: Status 404 returned error can't find the container with id 5f6fca90e6e700fd0cd4496c1cf4dba04284a0fe483c330bf363d41f08f071f0
May 20 15:34:37.159422 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:37.159388    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jm9g" event={"ID":"03f6c581-31ad-405b-a11c-5c6f9a77c10a","Type":"ContainerStarted","Data":"bc8e466824e90b1960bd68840f0593e46707875d35f751b9ae38504f221291f5"}
May 20 15:34:37.159725 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:37.159424    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jm9g" event={"ID":"03f6c581-31ad-405b-a11c-5c6f9a77c10a","Type":"ContainerStarted","Data":"6568ddbd82928894755dfa9dc3a8f1cd37a6af17eff43693960f0ddd45664605"}
May 20 15:34:37.159725 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:37.159439    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jm9g" event={"ID":"03f6c581-31ad-405b-a11c-5c6f9a77c10a","Type":"ContainerStarted","Data":"5f6fca90e6e700fd0cd4496c1cf4dba04284a0fe483c330bf363d41f08f071f0"}
May 20 15:34:38.431610 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:38.431569    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x"]
May 20 15:34:38.433475 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:38.433454    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x"
May 20 15:34:38.437658 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:38.437637    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 20 15:34:38.437754 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:38.437682    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fsnmf\""
May 20 15:34:38.444409 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:38.444380    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x"]
May 20 15:34:38.613084 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:38.613058    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b238b507-d1da-439a-a3df-9d745158cd5d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x\" (UID: \"b238b507-d1da-439a-a3df-9d745158cd5d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x"
May 20 15:34:38.713974 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:38.713930    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b238b507-d1da-439a-a3df-9d745158cd5d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x\" (UID: \"b238b507-d1da-439a-a3df-9d745158cd5d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x"
May 20 15:34:38.716161 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:38.716143    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b238b507-d1da-439a-a3df-9d745158cd5d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x\" (UID: \"b238b507-d1da-439a-a3df-9d745158cd5d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x"
May 20 15:34:38.742165 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:38.742142    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x"
May 20 15:34:38.859256 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:38.859230    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x"]
May 20 15:34:38.861729 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:34:38.861703    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb238b507_d1da_439a_a3df_9d745158cd5d.slice/crio-4e0af7cf23b25c6277e935f549ec8e26e67f85fbcc79bcefdb574e628d15d9f1 WatchSource:0}: Error finding container 4e0af7cf23b25c6277e935f549ec8e26e67f85fbcc79bcefdb574e628d15d9f1: Status 404 returned error can't find the container with id 4e0af7cf23b25c6277e935f549ec8e26e67f85fbcc79bcefdb574e628d15d9f1
May 20 15:34:39.167213 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:39.167143    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jm9g" event={"ID":"03f6c581-31ad-405b-a11c-5c6f9a77c10a","Type":"ContainerStarted","Data":"5ba68ba0f93b8003548e090af356966b8d2dd1730b3fa2142b55afa6a50dbf0e"}
May 20 15:34:39.168342 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:39.168310    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x" event={"ID":"b238b507-d1da-439a-a3df-9d745158cd5d","Type":"ContainerStarted","Data":"4e0af7cf23b25c6277e935f549ec8e26e67f85fbcc79bcefdb574e628d15d9f1"}
May 20 15:34:39.185731 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:39.185690    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6jm9g" podStartSLOduration=2.016135069 podStartE2EDuration="4.18567792s" podCreationTimestamp="2026-05-20 15:34:35 +0000 UTC" firstStartedPulling="2026-05-20 15:34:36.281941227 +0000 UTC m=+167.155942945" lastFinishedPulling="2026-05-20 15:34:38.451484066 +0000 UTC m=+169.325485796" observedRunningTime="2026-05-20 15:34:39.185095143 +0000 UTC m=+170.059096885" watchObservedRunningTime="2026-05-20 15:34:39.18567792 +0000 UTC m=+170.059679661"
May 20 15:34:39.689864 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:39.689838    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:34:39.692548 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:39.692531    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4srs2\""
May 20 15:34:39.700734 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:39.700712    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rz5m6"
May 20 15:34:39.827761 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:39.827731    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rz5m6"]
May 20 15:34:40.056782 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:34:40.056715    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d37ad86_bdaa_4e76_901a_c13a1fa6fbe8.slice/crio-055d09f4ebdccd3b4aea29dff0db9eec1171c8d87757cd1b6256605796c0b1ac WatchSource:0}: Error finding container 055d09f4ebdccd3b4aea29dff0db9eec1171c8d87757cd1b6256605796c0b1ac: Status 404 returned error can't find the container with id 055d09f4ebdccd3b4aea29dff0db9eec1171c8d87757cd1b6256605796c0b1ac
May 20 15:34:40.172152 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:40.172099    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rz5m6" event={"ID":"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8","Type":"ContainerStarted","Data":"055d09f4ebdccd3b4aea29dff0db9eec1171c8d87757cd1b6256605796c0b1ac"}
May 20 15:34:40.173257 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:40.173233    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x" event={"ID":"b238b507-d1da-439a-a3df-9d745158cd5d","Type":"ContainerStarted","Data":"9aecfc3e0e0df907f45ba962dbf83e6f11acf0c9f2ff7d88ac8bedf62d691b94"}
May 20 15:34:40.173710 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:40.173689    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x"
May 20 15:34:40.178721 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:40.178704    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x"
May 20 15:34:40.190704 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:40.190670    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x" podStartSLOduration=0.969214166 podStartE2EDuration="2.190659979s" podCreationTimestamp="2026-05-20 15:34:38 +0000 UTC" firstStartedPulling="2026-05-20 15:34:38.864071848 +0000 UTC m=+169.738073567" lastFinishedPulling="2026-05-20 15:34:40.085517653 +0000 UTC m=+170.959519380" observedRunningTime="2026-05-20 15:34:40.190102646 +0000 UTC m=+171.064104388" watchObservedRunningTime="2026-05-20 15:34:40.190659979 +0000 UTC m=+171.064661720"
May 20 15:34:40.688083 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:40.688049    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:34:42.178948 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:42.178910    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rz5m6" event={"ID":"5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8","Type":"ContainerStarted","Data":"77923de26a246ad6b6f6a9d77fc6c4913a16b6485a3077406dd74504355a9caa"}
May 20 15:34:42.196105 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:42.196059    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rz5m6" podStartSLOduration=137.500736587 podStartE2EDuration="2m19.1960458s" podCreationTimestamp="2026-05-20 15:32:23 +0000 UTC" firstStartedPulling="2026-05-20 15:34:40.058592326 +0000 UTC m=+170.932594048" lastFinishedPulling="2026-05-20 15:34:41.75390154 +0000 UTC m=+172.627903261" observedRunningTime="2026-05-20 15:34:42.195428294 +0000 UTC m=+173.069430036" watchObservedRunningTime="2026-05-20 15:34:42.1960458 +0000 UTC m=+173.070047540"
May 20 15:34:44.154411 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:44.154380    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xj6h5"
May 20 15:34:44.905827 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:44.905798    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nmmrs"]
May 20 15:34:44.908016 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:44.908000    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:44.910925 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:44.910711    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 20 15:34:44.910925 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:44.910733    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fklp5\""
May 20 15:34:44.911154 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:44.911092    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 20 15:34:44.911405 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:44.911386    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 20 15:34:44.913082 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:44.913059    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 20 15:34:44.913210 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:44.913084    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 20 15:34:44.913285 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:44.913263    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 20 15:34:45.061392 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.061351    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-textfile\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.061492 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.061408    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-tls\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.061492 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.061480    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-accelerators-collector-config\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.061572 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.061510    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-wtmp\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.061572 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.061533    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.061572 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.061549    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q7bl\" (UniqueName: \"kubernetes.io/projected/77e86c33-86ed-4d41-9962-33db29bb691d-kube-api-access-7q7bl\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.061572 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.061565    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77e86c33-86ed-4d41-9962-33db29bb691d-sys\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.061722 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.061608    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77e86c33-86ed-4d41-9962-33db29bb691d-root\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.061722 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.061640    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77e86c33-86ed-4d41-9962-33db29bb691d-metrics-client-ca\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.162951 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.162891    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.162951 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.162922    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7q7bl\" (UniqueName: \"kubernetes.io/projected/77e86c33-86ed-4d41-9962-33db29bb691d-kube-api-access-7q7bl\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.162951 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.162941    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77e86c33-86ed-4d41-9962-33db29bb691d-sys\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.163429 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.162967    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77e86c33-86ed-4d41-9962-33db29bb691d-root\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.163429 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.162994    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77e86c33-86ed-4d41-9962-33db29bb691d-metrics-client-ca\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.163429 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.163031    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-textfile\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.163429 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.163037    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77e86c33-86ed-4d41-9962-33db29bb691d-sys\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.163429 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.163053    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77e86c33-86ed-4d41-9962-33db29bb691d-root\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.163429 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.163062    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-tls\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.163429 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.163173    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-accelerators-collector-config\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.163429 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.163203    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-wtmp\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.163429 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.163339    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-wtmp\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.164032 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.163575    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-textfile\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.164032 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.163726    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-accelerators-collector-config\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.164032 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.163752    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77e86c33-86ed-4d41-9962-33db29bb691d-metrics-client-ca\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.165519 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.165496    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-tls\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.165622 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.165502    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77e86c33-86ed-4d41-9962-33db29bb691d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.176042 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.176018    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q7bl\" (UniqueName: \"kubernetes.io/projected/77e86c33-86ed-4d41-9962-33db29bb691d-kube-api-access-7q7bl\") pod \"node-exporter-nmmrs\" (UID: \"77e86c33-86ed-4d41-9962-33db29bb691d\") " pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.220605 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:45.220578    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nmmrs"
May 20 15:34:45.228602 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:34:45.228576    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e86c33_86ed_4d41_9962_33db29bb691d.slice/crio-b7facd903671b5047fbcf104c5171b67f0869ed1eb5ac903ea8725911e83a58d WatchSource:0}: Error finding container b7facd903671b5047fbcf104c5171b67f0869ed1eb5ac903ea8725911e83a58d: Status 404 returned error can't find the container with id b7facd903671b5047fbcf104c5171b67f0869ed1eb5ac903ea8725911e83a58d
May 20 15:34:46.191558 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:46.191521    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nmmrs" event={"ID":"77e86c33-86ed-4d41-9962-33db29bb691d","Type":"ContainerStarted","Data":"b7facd903671b5047fbcf104c5171b67f0869ed1eb5ac903ea8725911e83a58d"}
May 20 15:34:46.977594 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:46.977557    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-78b66885cb-d7z2s"]
May 20 15:34:46.979725 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:46.979707    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:46.982794 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:46.982768    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 20 15:34:46.982932 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:46.982818    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 20 15:34:46.982932 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:46.982776    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 20 15:34:46.983055 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:46.982825    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 20 15:34:46.983055 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:46.982945    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-w96zl\""
May 20 15:34:46.983055 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:46.982776    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-elq3rm4usfrhc\""
May 20 15:34:46.984036 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:46.984017    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 20 15:34:46.991363 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:46.991337    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78b66885cb-d7z2s"]
May 20 15:34:47.078385 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.078358    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bb6dcad-638a-4997-bc06-5a358183dd4e-metrics-client-ca\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.078503 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.078388    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.078503 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.078416    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.078503 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.078470    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-grpc-tls\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.078640 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.078528    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv7sn\" (UniqueName: \"kubernetes.io/projected/3bb6dcad-638a-4997-bc06-5a358183dd4e-kube-api-access-sv7sn\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.078640 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.078561    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.078640 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.078630    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.078732 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.078675    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-tls\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.178938 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.178915    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bb6dcad-638a-4997-bc06-5a358183dd4e-metrics-client-ca\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.179036 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.178948    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.179036 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.178981    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.179036 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.179006    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-grpc-tls\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.179212 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.179050    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sv7sn\" (UniqueName: \"kubernetes.io/projected/3bb6dcad-638a-4997-bc06-5a358183dd4e-kube-api-access-sv7sn\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.179212 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.179079    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.179212 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.179135    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.179212 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.179167    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-tls\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.179778 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.179729    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bb6dcad-638a-4997-bc06-5a358183dd4e-metrics-client-ca\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.181864 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.181841    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.182023 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.182007    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-tls\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.182268 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.182247    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.182344 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.182281    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-grpc-tls\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.182344 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.182307    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.182344 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.182307    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3bb6dcad-638a-4997-bc06-5a358183dd4e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.188531 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.188509    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv7sn\" (UniqueName: \"kubernetes.io/projected/3bb6dcad-638a-4997-bc06-5a358183dd4e-kube-api-access-sv7sn\") pod \"thanos-querier-78b66885cb-d7z2s\" (UID: \"3bb6dcad-638a-4997-bc06-5a358183dd4e\") " pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.195795 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.195764    2551 generic.go:358] "Generic (PLEG): container finished" podID="77e86c33-86ed-4d41-9962-33db29bb691d" containerID="347e95f7449b0f484d61f4da9adeb552580a6b1b104689976b258b8d53480a05" exitCode=0
May 20 15:34:47.196065 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.195802    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nmmrs" event={"ID":"77e86c33-86ed-4d41-9962-33db29bb691d","Type":"ContainerDied","Data":"347e95f7449b0f484d61f4da9adeb552580a6b1b104689976b258b8d53480a05"}
May 20 15:34:47.289298 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.289276    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:47.418329 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:47.418303    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78b66885cb-d7z2s"]
May 20 15:34:47.421547 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:34:47.421519    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb6dcad_638a_4997_bc06_5a358183dd4e.slice/crio-5f6096edaafbdc36eeae228d5459b0bd16e66dbea64af4226f183bc4edcddcc4 WatchSource:0}: Error finding container 5f6096edaafbdc36eeae228d5459b0bd16e66dbea64af4226f183bc4edcddcc4: Status 404 returned error can't find the container with id 5f6096edaafbdc36eeae228d5459b0bd16e66dbea64af4226f183bc4edcddcc4
May 20 15:34:48.199886 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:48.199844    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s" event={"ID":"3bb6dcad-638a-4997-bc06-5a358183dd4e","Type":"ContainerStarted","Data":"5f6096edaafbdc36eeae228d5459b0bd16e66dbea64af4226f183bc4edcddcc4"}
May 20 15:34:48.202687 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:48.202616    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nmmrs" event={"ID":"77e86c33-86ed-4d41-9962-33db29bb691d","Type":"ContainerStarted","Data":"0c97c34c9043545c25888bdaf95462f1edf9b9c05b84e3939ff7e38a7bab03ca"}
May 20 15:34:48.202687 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:48.202664    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nmmrs" event={"ID":"77e86c33-86ed-4d41-9962-33db29bb691d","Type":"ContainerStarted","Data":"8016c4100b3942d4d33d2c7858f9f2161113ed463a6e1d3106375a4e1e232974"}
May 20 15:34:48.233194 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:48.233144    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nmmrs" podStartSLOduration=3.237562864 podStartE2EDuration="4.233127217s" podCreationTimestamp="2026-05-20 15:34:44 +0000 UTC" firstStartedPulling="2026-05-20 15:34:45.230226967 +0000 UTC m=+176.104228686" lastFinishedPulling="2026-05-20 15:34:46.225791301 +0000 UTC m=+177.099793039" observedRunningTime="2026-05-20 15:34:48.232248798 +0000 UTC m=+179.106250543" watchObservedRunningTime="2026-05-20 15:34:48.233127217 +0000 UTC m=+179.107128955"
May 20 15:34:49.206849 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:49.206823    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s" event={"ID":"3bb6dcad-638a-4997-bc06-5a358183dd4e","Type":"ContainerStarted","Data":"9fcbfcaf7134c8fdf0262fd771832be956450c2de31d2b09c53bb945b425476f"}
May 20 15:34:49.207145 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:49.206858    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s" event={"ID":"3bb6dcad-638a-4997-bc06-5a358183dd4e","Type":"ContainerStarted","Data":"7b0a04cc09859e4d2d25b730af69c9d6c7cb1cf75d7f458f7782221c5f412aa7"}
May 20 15:34:50.211451 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:50.211375    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s" event={"ID":"3bb6dcad-638a-4997-bc06-5a358183dd4e","Type":"ContainerStarted","Data":"ca8c1f199af610098875cea3d99af1a5b1e0463fb9dee78d43bf9f407418a355"}
May 20 15:34:50.211451 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:50.211421    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s" event={"ID":"3bb6dcad-638a-4997-bc06-5a358183dd4e","Type":"ContainerStarted","Data":"4623980429b1ef0588d06f295345f029ce8d9b5d6ca0fd92df568e0099dfee87"}
May 20 15:34:50.211451 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:50.211435    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s" event={"ID":"3bb6dcad-638a-4997-bc06-5a358183dd4e","Type":"ContainerStarted","Data":"1151e27a1f2e6a282797d1f1c5ae696072340f7c0b2367a6a87a1093a85fe942"}
May 20 15:34:50.211451 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:50.211448    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s" event={"ID":"3bb6dcad-638a-4997-bc06-5a358183dd4e","Type":"ContainerStarted","Data":"130b18d9d71672bc4a6d5ea063d05e56b079a6984ddc970367ed7ede0c1286ad"}
May 20 15:34:50.211880 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:50.211591    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:50.243739 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:50.243694    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s" podStartSLOduration=1.770509144 podStartE2EDuration="4.243682009s" podCreationTimestamp="2026-05-20 15:34:46 +0000 UTC" firstStartedPulling="2026-05-20 15:34:47.423493291 +0000 UTC m=+178.297495013" lastFinishedPulling="2026-05-20 15:34:49.89666615 +0000 UTC m=+180.770667878" observedRunningTime="2026-05-20 15:34:50.241895628 +0000 UTC m=+181.115897369" watchObservedRunningTime="2026-05-20 15:34:50.243682009 +0000 UTC m=+181.117683746"
May 20 15:34:56.220483 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:56.220457    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-78b66885cb-d7z2s"
May 20 15:34:58.758323 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:58.758286    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-rx45v"]
May 20 15:34:58.761310 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:58.761290    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-rx45v"
May 20 15:34:58.764347 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:58.764319    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 20 15:34:58.764492 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:58.764354    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 20 15:34:58.764492 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:58.764398    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bhsl2\""
May 20 15:34:58.773921 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:58.773895    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-rx45v"]
May 20 15:34:58.853347 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:58.853328    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh2hv\" (UniqueName: \"kubernetes.io/projected/a8a14a0c-5ad4-45a9-8e83-a1d659a587de-kube-api-access-dh2hv\") pod \"downloads-57bd96b888-rx45v\" (UID: \"a8a14a0c-5ad4-45a9-8e83-a1d659a587de\") " pod="openshift-console/downloads-57bd96b888-rx45v"
May 20 15:34:58.953699 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:58.953675    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh2hv\" (UniqueName: \"kubernetes.io/projected/a8a14a0c-5ad4-45a9-8e83-a1d659a587de-kube-api-access-dh2hv\") pod \"downloads-57bd96b888-rx45v\" (UID: \"a8a14a0c-5ad4-45a9-8e83-a1d659a587de\") " pod="openshift-console/downloads-57bd96b888-rx45v"
May 20 15:34:58.964946 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:58.964916    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh2hv\" (UniqueName: \"kubernetes.io/projected/a8a14a0c-5ad4-45a9-8e83-a1d659a587de-kube-api-access-dh2hv\") pod \"downloads-57bd96b888-rx45v\" (UID: \"a8a14a0c-5ad4-45a9-8e83-a1d659a587de\") " pod="openshift-console/downloads-57bd96b888-rx45v"
May 20 15:34:59.070803 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:59.070746    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-rx45v"
May 20 15:34:59.191886 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:59.191823    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-rx45v"]
May 20 15:34:59.194664 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:34:59.194636    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a14a0c_5ad4_45a9_8e83_a1d659a587de.slice/crio-b40b119e57965f4e7c33cbb015fde583953a848e9f687cbb6b28df4b58079182 WatchSource:0}: Error finding container b40b119e57965f4e7c33cbb015fde583953a848e9f687cbb6b28df4b58079182: Status 404 returned error can't find the container with id b40b119e57965f4e7c33cbb015fde583953a848e9f687cbb6b28df4b58079182
May 20 15:34:59.236303 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:34:59.236274    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-rx45v" event={"ID":"a8a14a0c-5ad4-45a9-8e83-a1d659a587de","Type":"ContainerStarted","Data":"b40b119e57965f4e7c33cbb015fde583953a848e9f687cbb6b28df4b58079182"}
May 20 15:35:15.284717 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:15.284677    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-rx45v" event={"ID":"a8a14a0c-5ad4-45a9-8e83-a1d659a587de","Type":"ContainerStarted","Data":"8f06d86b0b391e15c4946f3a9433ec312d9dd74ad527a4bd79fd3924dfc35ae8"}
May 20 15:35:15.285260 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:15.285058    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-rx45v"
May 20 15:35:15.300286 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:15.300261    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-rx45v"
May 20 15:35:15.305747 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:15.305597    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-rx45v" podStartSLOduration=1.9376988050000001 podStartE2EDuration="17.305573504s" podCreationTimestamp="2026-05-20 15:34:58 +0000 UTC" firstStartedPulling="2026-05-20 15:34:59.196936632 +0000 UTC m=+190.070938373" lastFinishedPulling="2026-05-20 15:35:14.564811353 +0000 UTC m=+205.438813072" observedRunningTime="2026-05-20 15:35:15.303103381 +0000 UTC m=+206.177105123" watchObservedRunningTime="2026-05-20 15:35:15.305573504 +0000 UTC m=+206.179575247"
May 20 15:35:21.436970 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:21.436923    2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" podUID="4dc526f1-d106-444b-b59d-3c029198357b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 20 15:35:31.437160 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:31.437090    2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" podUID="4dc526f1-d106-444b-b59d-3c029198357b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 20 15:35:41.437017 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:41.436973    2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" podUID="4dc526f1-d106-444b-b59d-3c029198357b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 20 15:35:41.437520 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:41.437052    2551 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f"
May 20 15:35:41.437576 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:41.437544    2551 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"ccb330cf77ee2396c6d88db7b65e07a83585e7cb9a32d032aa961baa47864d0b"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 20 15:35:41.437639 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:41.437622    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" podUID="4dc526f1-d106-444b-b59d-3c029198357b" containerName="service-proxy" containerID="cri-o://ccb330cf77ee2396c6d88db7b65e07a83585e7cb9a32d032aa961baa47864d0b" gracePeriod=30
May 20 15:35:42.359857 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:42.359825    2551 generic.go:358] "Generic (PLEG): container finished" podID="4dc526f1-d106-444b-b59d-3c029198357b" containerID="ccb330cf77ee2396c6d88db7b65e07a83585e7cb9a32d032aa961baa47864d0b" exitCode=2
May 20 15:35:42.360027 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:42.359888    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" event={"ID":"4dc526f1-d106-444b-b59d-3c029198357b","Type":"ContainerDied","Data":"ccb330cf77ee2396c6d88db7b65e07a83585e7cb9a32d032aa961baa47864d0b"}
May 20 15:35:42.360027 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:35:42.359923    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7849b4c-r6z6f" event={"ID":"4dc526f1-d106-444b-b59d-3c029198357b","Type":"ContainerStarted","Data":"8ed80715ab8d8dfa9f7fd922350c83ba9c354706b4b8d17d7f9f4b998562bb3d"}
May 20 15:36:01.496147 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:36:01.496025    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:36:01.499018 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:36:01.498995    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1788a026-1004-47b0-87a4-192bdb1ecf17-metrics-certs\") pod \"network-metrics-daemon-9mbp7\" (UID: \"1788a026-1004-47b0-87a4-192bdb1ecf17\") " pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:36:01.691445 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:36:01.691418    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sz56g\""
May 20 15:36:01.699167 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:36:01.699144    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbp7"
May 20 15:36:01.823294 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:36:01.823267    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9mbp7"]
May 20 15:36:01.825827 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:36:01.825797    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1788a026_1004_47b0_87a4_192bdb1ecf17.slice/crio-70af05690c2af66bb61528b8ebea50d15474c17db056c848fd8d1eca88c72d4c WatchSource:0}: Error finding container 70af05690c2af66bb61528b8ebea50d15474c17db056c848fd8d1eca88c72d4c: Status 404 returned error can't find the container with id 70af05690c2af66bb61528b8ebea50d15474c17db056c848fd8d1eca88c72d4c
May 20 15:36:02.416817 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:36:02.416782    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9mbp7" event={"ID":"1788a026-1004-47b0-87a4-192bdb1ecf17","Type":"ContainerStarted","Data":"70af05690c2af66bb61528b8ebea50d15474c17db056c848fd8d1eca88c72d4c"}
May 20 15:36:03.422459 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:36:03.422411    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9mbp7" event={"ID":"1788a026-1004-47b0-87a4-192bdb1ecf17","Type":"ContainerStarted","Data":"a72b87320e8c07d1923c64143dcdc337bcb0027bbc04b82d41464a249e1b9e50"}
May 20 15:36:03.422459 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:36:03.422453    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9mbp7" event={"ID":"1788a026-1004-47b0-87a4-192bdb1ecf17","Type":"ContainerStarted","Data":"27191c421029842f236bfa8a8d1ab55ee47b87bc79329fcfecab84fb536dc58d"}
May 20 15:36:03.440783 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:36:03.440732    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9mbp7" podStartSLOduration=253.415608145 podStartE2EDuration="4m14.44071735s" podCreationTimestamp="2026-05-20 15:31:49 +0000 UTC" firstStartedPulling="2026-05-20 15:36:01.827627232 +0000 UTC m=+252.701628950" lastFinishedPulling="2026-05-20 15:36:02.852736437 +0000 UTC m=+253.726738155" observedRunningTime="2026-05-20 15:36:03.439363356 +0000 UTC m=+254.313365097" watchObservedRunningTime="2026-05-20 15:36:03.44071735 +0000 UTC m=+254.314719088"
May 20 15:36:49.572849 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:36:49.572818    2551 kubelet.go:1628] "Image garbage collection succeeded"
May 20 15:38:14.529158 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.529100    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dhv8s"]
May 20 15:38:14.531553 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.531519    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhv8s"
May 20 15:38:14.534371 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.534346    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 15:38:14.540770 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.540745    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dhv8s"]
May 20 15:38:14.681709 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.681684    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3204c49-b248-4926-8e83-996e825134ad-original-pull-secret\") pod \"global-pull-secret-syncer-dhv8s\" (UID: \"e3204c49-b248-4926-8e83-996e825134ad\") " pod="kube-system/global-pull-secret-syncer-dhv8s"
May 20 15:38:14.681812 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.681714    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3204c49-b248-4926-8e83-996e825134ad-kubelet-config\") pod \"global-pull-secret-syncer-dhv8s\" (UID: \"e3204c49-b248-4926-8e83-996e825134ad\") " pod="kube-system/global-pull-secret-syncer-dhv8s"
May 20 15:38:14.681812 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.681747    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3204c49-b248-4926-8e83-996e825134ad-dbus\") pod \"global-pull-secret-syncer-dhv8s\" (UID: \"e3204c49-b248-4926-8e83-996e825134ad\") " pod="kube-system/global-pull-secret-syncer-dhv8s"
May 20 15:38:14.782802 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.782745    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3204c49-b248-4926-8e83-996e825134ad-original-pull-secret\") pod \"global-pull-secret-syncer-dhv8s\" (UID: \"e3204c49-b248-4926-8e83-996e825134ad\") " pod="kube-system/global-pull-secret-syncer-dhv8s"
May 20 15:38:14.782802 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.782780    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3204c49-b248-4926-8e83-996e825134ad-kubelet-config\") pod \"global-pull-secret-syncer-dhv8s\" (UID: \"e3204c49-b248-4926-8e83-996e825134ad\") " pod="kube-system/global-pull-secret-syncer-dhv8s"
May 20 15:38:14.782940 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.782813    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3204c49-b248-4926-8e83-996e825134ad-dbus\") pod \"global-pull-secret-syncer-dhv8s\" (UID: \"e3204c49-b248-4926-8e83-996e825134ad\") " pod="kube-system/global-pull-secret-syncer-dhv8s"
May 20 15:38:14.782940 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.782889    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e3204c49-b248-4926-8e83-996e825134ad-kubelet-config\") pod \"global-pull-secret-syncer-dhv8s\" (UID: \"e3204c49-b248-4926-8e83-996e825134ad\") " pod="kube-system/global-pull-secret-syncer-dhv8s"
May 20 15:38:14.783047 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.782946    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e3204c49-b248-4926-8e83-996e825134ad-dbus\") pod \"global-pull-secret-syncer-dhv8s\" (UID: \"e3204c49-b248-4926-8e83-996e825134ad\") " pod="kube-system/global-pull-secret-syncer-dhv8s"
May 20 15:38:14.785471 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.785450    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e3204c49-b248-4926-8e83-996e825134ad-original-pull-secret\") pod \"global-pull-secret-syncer-dhv8s\" (UID: \"e3204c49-b248-4926-8e83-996e825134ad\") " pod="kube-system/global-pull-secret-syncer-dhv8s"
May 20 15:38:14.842353 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.842331    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhv8s"
May 20 15:38:14.964151 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.964085    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dhv8s"]
May 20 15:38:14.966755 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:38:14.966732    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3204c49_b248_4926_8e83_996e825134ad.slice/crio-63363820b2f3a7c990e36cc23d53d90e2c3ab6f5021096cb760a22612b947ae1 WatchSource:0}: Error finding container 63363820b2f3a7c990e36cc23d53d90e2c3ab6f5021096cb760a22612b947ae1: Status 404 returned error can't find the container with id 63363820b2f3a7c990e36cc23d53d90e2c3ab6f5021096cb760a22612b947ae1
May 20 15:38:14.968366 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:14.968352    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 15:38:15.790386 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:15.790344    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dhv8s" event={"ID":"e3204c49-b248-4926-8e83-996e825134ad","Type":"ContainerStarted","Data":"63363820b2f3a7c990e36cc23d53d90e2c3ab6f5021096cb760a22612b947ae1"}
May 20 15:38:19.801999 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:19.801970    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dhv8s" event={"ID":"e3204c49-b248-4926-8e83-996e825134ad","Type":"ContainerStarted","Data":"ae3665627cba1a8ba803c36104e6be0bae6635bbe40483be21936b49568b595b"}
May 20 15:38:19.819630 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:38:19.819584    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dhv8s" podStartSLOduration=1.862797394 podStartE2EDuration="5.819571979s" podCreationTimestamp="2026-05-20 15:38:14 +0000 UTC" firstStartedPulling="2026-05-20 15:38:14.968477667 +0000 UTC m=+385.842479386" lastFinishedPulling="2026-05-20 15:38:18.925252238 +0000 UTC m=+389.799253971" observedRunningTime="2026-05-20 15:38:19.818712107 +0000 UTC m=+390.692713848" watchObservedRunningTime="2026-05-20 15:38:19.819571979 +0000 UTC m=+390.693573757"
May 20 15:40:06.806445 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.806410    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"]
May 20 15:40:06.809279 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.809261    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:06.813633 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.813609    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
May 20 15:40:06.814018 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.814001    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
May 20 15:40:06.815054 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.815035    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-k6rd5\""
May 20 15:40:06.815168 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.815140    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
May 20 15:40:06.815338 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.815317    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
May 20 15:40:06.815447 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.815432    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
May 20 15:40:06.837929 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.837902    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"]
May 20 15:40:06.936854 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.936834    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klkwr\" (UniqueName: \"kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-kube-api-access-klkwr\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:06.936961 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.936867    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e4956a4f-ced6-4553-8951-a0f440aa6243-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:06.936961 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:06.936892    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:07.037434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.037406    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e4956a4f-ced6-4553-8951-a0f440aa6243-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:07.037434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.037435    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:07.037618 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.037485    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klkwr\" (UniqueName: \"kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-kube-api-access-klkwr\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:07.037618 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:07.037608    2551 secret.go:281] references non-existent secret key: tls.crt
May 20 15:40:07.037707 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:07.037624    2551 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 20 15:40:07.037707 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:07.037644    2551 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m: references non-existent secret key: tls.crt
May 20 15:40:07.037707 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:07.037705    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates podName:e4956a4f-ced6-4553-8951-a0f440aa6243 nodeName:}" failed. No retries permitted until 2026-05-20 15:40:07.53768809 +0000 UTC m=+498.411689809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates") pod "keda-metrics-apiserver-7c9f485588-ws86m" (UID: "e4956a4f-ced6-4553-8951-a0f440aa6243") : references non-existent secret key: tls.crt
May 20 15:40:07.037812 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.037791    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e4956a4f-ced6-4553-8951-a0f440aa6243-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:07.061397 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.061341    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klkwr\" (UniqueName: \"kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-kube-api-access-klkwr\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:07.166302 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.166269    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-cf49989db-8fzrk"]
May 20 15:40:07.169315 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.169300    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-8fzrk"
May 20 15:40:07.172787 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.172767    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
May 20 15:40:07.182167 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.182143    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-8fzrk"]
May 20 15:40:07.239153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.239102    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fb71e798-99dd-46f7-b994-86eb7efaf24a-certificates\") pod \"keda-admission-cf49989db-8fzrk\" (UID: \"fb71e798-99dd-46f7-b994-86eb7efaf24a\") " pod="openshift-keda/keda-admission-cf49989db-8fzrk"
May 20 15:40:07.239302 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.239199    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsd5v\" (UniqueName: \"kubernetes.io/projected/fb71e798-99dd-46f7-b994-86eb7efaf24a-kube-api-access-fsd5v\") pod \"keda-admission-cf49989db-8fzrk\" (UID: \"fb71e798-99dd-46f7-b994-86eb7efaf24a\") " pod="openshift-keda/keda-admission-cf49989db-8fzrk"
May 20 15:40:07.339800 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.339774    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fb71e798-99dd-46f7-b994-86eb7efaf24a-certificates\") pod \"keda-admission-cf49989db-8fzrk\" (UID: \"fb71e798-99dd-46f7-b994-86eb7efaf24a\") " pod="openshift-keda/keda-admission-cf49989db-8fzrk"
May 20 15:40:07.339925 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.339831    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsd5v\" (UniqueName: \"kubernetes.io/projected/fb71e798-99dd-46f7-b994-86eb7efaf24a-kube-api-access-fsd5v\") pod \"keda-admission-cf49989db-8fzrk\" (UID: \"fb71e798-99dd-46f7-b994-86eb7efaf24a\") " pod="openshift-keda/keda-admission-cf49989db-8fzrk"
May 20 15:40:07.342410 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.342393    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fb71e798-99dd-46f7-b994-86eb7efaf24a-certificates\") pod \"keda-admission-cf49989db-8fzrk\" (UID: \"fb71e798-99dd-46f7-b994-86eb7efaf24a\") " pod="openshift-keda/keda-admission-cf49989db-8fzrk"
May 20 15:40:07.348553 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.348531    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsd5v\" (UniqueName: \"kubernetes.io/projected/fb71e798-99dd-46f7-b994-86eb7efaf24a-kube-api-access-fsd5v\") pod \"keda-admission-cf49989db-8fzrk\" (UID: \"fb71e798-99dd-46f7-b994-86eb7efaf24a\") " pod="openshift-keda/keda-admission-cf49989db-8fzrk"
May 20 15:40:07.479466 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.479423    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-8fzrk"
May 20 15:40:07.540940 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.540901    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:07.541126 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:07.541056    2551 secret.go:281] references non-existent secret key: tls.crt
May 20 15:40:07.541126 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:07.541080    2551 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 20 15:40:07.541248 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:07.541105    2551 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m: references non-existent secret key: tls.crt
May 20 15:40:07.541307 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:07.541245    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates podName:e4956a4f-ced6-4553-8951-a0f440aa6243 nodeName:}" failed. No retries permitted until 2026-05-20 15:40:08.541204146 +0000 UTC m=+499.415205868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates") pod "keda-metrics-apiserver-7c9f485588-ws86m" (UID: "e4956a4f-ced6-4553-8951-a0f440aa6243") : references non-existent secret key: tls.crt
May 20 15:40:07.615920 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:07.615895    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-8fzrk"]
May 20 15:40:07.618350 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:40:07.618326    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb71e798_99dd_46f7_b994_86eb7efaf24a.slice/crio-4f1ad06b1e27eec8a6078be712a03d4b6889019464c5c1b1fdc25ce01c4ea6d6 WatchSource:0}: Error finding container 4f1ad06b1e27eec8a6078be712a03d4b6889019464c5c1b1fdc25ce01c4ea6d6: Status 404 returned error can't find the container with id 4f1ad06b1e27eec8a6078be712a03d4b6889019464c5c1b1fdc25ce01c4ea6d6
May 20 15:40:08.100764 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:08.100724    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-8fzrk" event={"ID":"fb71e798-99dd-46f7-b994-86eb7efaf24a","Type":"ContainerStarted","Data":"4f1ad06b1e27eec8a6078be712a03d4b6889019464c5c1b1fdc25ce01c4ea6d6"}
May 20 15:40:08.548088 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:08.547996    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:08.548250 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:08.548170    2551 secret.go:281] references non-existent secret key: tls.crt
May 20 15:40:08.548250 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:08.548192    2551 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
May 20 15:40:08.548250 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:08.548216    2551 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m: references non-existent secret key: tls.crt
May 20 15:40:08.548358 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:40:08.548286    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates podName:e4956a4f-ced6-4553-8951-a0f440aa6243 nodeName:}" failed. No retries permitted until 2026-05-20 15:40:10.548264873 +0000 UTC m=+501.422266594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates") pod "keda-metrics-apiserver-7c9f485588-ws86m" (UID: "e4956a4f-ced6-4553-8951-a0f440aa6243") : references non-existent secret key: tls.crt
May 20 15:40:10.563838 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:10.563814    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:10.566502 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:10.566481    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e4956a4f-ced6-4553-8951-a0f440aa6243-certificates\") pod \"keda-metrics-apiserver-7c9f485588-ws86m\" (UID: \"e4956a4f-ced6-4553-8951-a0f440aa6243\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:10.719481 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:10.719460    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:10.845568 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:10.845521    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"]
May 20 15:40:10.848135 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:40:10.848090    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4956a4f_ced6_4553_8951_a0f440aa6243.slice/crio-62888269a6c092cbc3f697db31eeb71e7afe29dd0af0d1d98ba76f0673af8b2c WatchSource:0}: Error finding container 62888269a6c092cbc3f697db31eeb71e7afe29dd0af0d1d98ba76f0673af8b2c: Status 404 returned error can't find the container with id 62888269a6c092cbc3f697db31eeb71e7afe29dd0af0d1d98ba76f0673af8b2c
May 20 15:40:11.111878 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:11.111848    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-8fzrk" event={"ID":"fb71e798-99dd-46f7-b994-86eb7efaf24a","Type":"ContainerStarted","Data":"11fd31afc4bb66e51e50a9d50d62aade2c892d95999ae2111ad6b1cd98eebdeb"}
May 20 15:40:11.112027 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:11.111977    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-cf49989db-8fzrk"
May 20 15:40:11.112969 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:11.112945    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m" event={"ID":"e4956a4f-ced6-4553-8951-a0f440aa6243","Type":"ContainerStarted","Data":"62888269a6c092cbc3f697db31eeb71e7afe29dd0af0d1d98ba76f0673af8b2c"}
May 20 15:40:11.130612 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:11.130569    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-admission-cf49989db-8fzrk" podStartSLOduration=1.275524883 podStartE2EDuration="4.130556136s" podCreationTimestamp="2026-05-20 15:40:07 +0000 UTC" firstStartedPulling="2026-05-20 15:40:07.619534155 +0000 UTC m=+498.493535874" lastFinishedPulling="2026-05-20 15:40:10.474565404 +0000 UTC m=+501.348567127" observedRunningTime="2026-05-20 15:40:11.130280252 +0000 UTC m=+502.004282169" watchObservedRunningTime="2026-05-20 15:40:11.130556136 +0000 UTC m=+502.004557876"
May 20 15:40:15.126231 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:15.126198    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m" event={"ID":"e4956a4f-ced6-4553-8951-a0f440aa6243","Type":"ContainerStarted","Data":"621705dd9d67e177842495a7a44b8b5bda25641939edd89ddcedfb6e959d6568"}
May 20 15:40:15.126594 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:15.126333    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:15.149543 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:15.149493    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m" podStartSLOduration=5.569782283 podStartE2EDuration="9.149480593s" podCreationTimestamp="2026-05-20 15:40:06 +0000 UTC" firstStartedPulling="2026-05-20 15:40:10.849463442 +0000 UTC m=+501.723465161" lastFinishedPulling="2026-05-20 15:40:14.42916175 +0000 UTC m=+505.303163471" observedRunningTime="2026-05-20 15:40:15.148174669 +0000 UTC m=+506.022176411" watchObservedRunningTime="2026-05-20 15:40:15.149480593 +0000 UTC m=+506.023482334"
May 20 15:40:26.134875 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:26.134846    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-ws86m"
May 20 15:40:32.118236 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:40:32.118138    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-cf49989db-8fzrk"
May 20 15:41:15.406590 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.406554    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"]
May 20 15:41:15.408516 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.408499    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"
May 20 15:41:15.411492 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.411469    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
May 20 15:41:15.412235 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.412216    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
May 20 15:41:15.412294 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.412245    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
May 20 15:41:15.412337 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.412302    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-526g5\""
May 20 15:41:15.420748 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.420727    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"]
May 20 15:41:15.509519 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.509492    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhrbw\" (UniqueName: \"kubernetes.io/projected/a23ab591-6408-483f-9ae1-27ae2440c5d3-kube-api-access-mhrbw\") pod \"llmisvc-controller-manager-68cc5db7c4-w74vq\" (UID: \"a23ab591-6408-483f-9ae1-27ae2440c5d3\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"
May 20 15:41:15.509691 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.509552    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a23ab591-6408-483f-9ae1-27ae2440c5d3-cert\") pod \"llmisvc-controller-manager-68cc5db7c4-w74vq\" (UID: \"a23ab591-6408-483f-9ae1-27ae2440c5d3\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"
May 20 15:41:15.610736 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.610706    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhrbw\" (UniqueName: \"kubernetes.io/projected/a23ab591-6408-483f-9ae1-27ae2440c5d3-kube-api-access-mhrbw\") pod \"llmisvc-controller-manager-68cc5db7c4-w74vq\" (UID: \"a23ab591-6408-483f-9ae1-27ae2440c5d3\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"
May 20 15:41:15.610887 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.610766    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a23ab591-6408-483f-9ae1-27ae2440c5d3-cert\") pod \"llmisvc-controller-manager-68cc5db7c4-w74vq\" (UID: \"a23ab591-6408-483f-9ae1-27ae2440c5d3\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"
May 20 15:41:15.613304 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.613282    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a23ab591-6408-483f-9ae1-27ae2440c5d3-cert\") pod \"llmisvc-controller-manager-68cc5db7c4-w74vq\" (UID: \"a23ab591-6408-483f-9ae1-27ae2440c5d3\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"
May 20 15:41:15.620670 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.620650    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhrbw\" (UniqueName: \"kubernetes.io/projected/a23ab591-6408-483f-9ae1-27ae2440c5d3-kube-api-access-mhrbw\") pod \"llmisvc-controller-manager-68cc5db7c4-w74vq\" (UID: \"a23ab591-6408-483f-9ae1-27ae2440c5d3\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"
May 20 15:41:15.718797 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.718729    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"
May 20 15:41:15.843365 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:15.843341    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"]
May 20 15:41:15.845552 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:41:15.845516    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda23ab591_6408_483f_9ae1_27ae2440c5d3.slice/crio-079c1441293300d62fd721d17194e1b8c7eba3d253437700e8554c385c68fb39 WatchSource:0}: Error finding container 079c1441293300d62fd721d17194e1b8c7eba3d253437700e8554c385c68fb39: Status 404 returned error can't find the container with id 079c1441293300d62fd721d17194e1b8c7eba3d253437700e8554c385c68fb39
May 20 15:41:16.298731 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:16.298696    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq" event={"ID":"a23ab591-6408-483f-9ae1-27ae2440c5d3","Type":"ContainerStarted","Data":"079c1441293300d62fd721d17194e1b8c7eba3d253437700e8554c385c68fb39"}
May 20 15:41:18.305879 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:18.305839    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq" event={"ID":"a23ab591-6408-483f-9ae1-27ae2440c5d3","Type":"ContainerStarted","Data":"2397500fda23a8fb8aeeb4bd08634f604a483bcbb264c47f280f20e4860b414a"}
May 20 15:41:18.306344 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:18.305949    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"
May 20 15:41:18.327549 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:18.327503    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq" podStartSLOduration=1.417003095 podStartE2EDuration="3.327489682s" podCreationTimestamp="2026-05-20 15:41:15 +0000 UTC" firstStartedPulling="2026-05-20 15:41:15.848461333 +0000 UTC m=+566.722463071" lastFinishedPulling="2026-05-20 15:41:17.75894794 +0000 UTC m=+568.632949658" observedRunningTime="2026-05-20 15:41:18.325750575 +0000 UTC m=+569.199752316" watchObservedRunningTime="2026-05-20 15:41:18.327489682 +0000 UTC m=+569.201491423"
May 20 15:41:49.311086 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:41:49.311054    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-68cc5db7c4-w74vq"
May 20 15:42:24.731897 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.731866    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-86f7b4b499-r9fgg"]
May 20 15:42:24.734972 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.734956    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-r9fgg"
May 20 15:42:24.738020 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.737989    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
May 20 15:42:24.738020 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.737996    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-h7vtz\""
May 20 15:42:24.743481 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.743458    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-r9fgg"]
May 20 15:42:24.746224 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.746204    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-696fc77849-t5cf8"]
May 20 15:42:24.749137 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.749098    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-696fc77849-t5cf8"
May 20 15:42:24.752407 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.752390    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
May 20 15:42:24.752653 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.752637    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-hwd22\""
May 20 15:42:24.760705 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.760684    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-696fc77849-t5cf8"]
May 20 15:42:24.871073 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.871047    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7q69\" (UniqueName: \"kubernetes.io/projected/070df8d7-baf3-43b2-9ad2-5590351808bf-kube-api-access-q7q69\") pod \"odh-model-controller-696fc77849-t5cf8\" (UID: \"070df8d7-baf3-43b2-9ad2-5590351808bf\") " pod="kserve/odh-model-controller-696fc77849-t5cf8"
May 20 15:42:24.871206 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.871082    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxtff\" (UniqueName: \"kubernetes.io/projected/9851e9c5-6eed-4f92-a46f-8c17945c6d5e-kube-api-access-zxtff\") pod \"model-serving-api-86f7b4b499-r9fgg\" (UID: \"9851e9c5-6eed-4f92-a46f-8c17945c6d5e\") " pod="kserve/model-serving-api-86f7b4b499-r9fgg"
May 20 15:42:24.871206 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.871103    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9851e9c5-6eed-4f92-a46f-8c17945c6d5e-tls-certs\") pod \"model-serving-api-86f7b4b499-r9fgg\" (UID: \"9851e9c5-6eed-4f92-a46f-8c17945c6d5e\") " pod="kserve/model-serving-api-86f7b4b499-r9fgg"
May 20 15:42:24.871206 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.871180    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/070df8d7-baf3-43b2-9ad2-5590351808bf-cert\") pod \"odh-model-controller-696fc77849-t5cf8\" (UID: \"070df8d7-baf3-43b2-9ad2-5590351808bf\") " pod="kserve/odh-model-controller-696fc77849-t5cf8"
May 20 15:42:24.971795 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.971766    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7q69\" (UniqueName: \"kubernetes.io/projected/070df8d7-baf3-43b2-9ad2-5590351808bf-kube-api-access-q7q69\") pod \"odh-model-controller-696fc77849-t5cf8\" (UID: \"070df8d7-baf3-43b2-9ad2-5590351808bf\") " pod="kserve/odh-model-controller-696fc77849-t5cf8"
May 20 15:42:24.971911 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.971803    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxtff\" (UniqueName: \"kubernetes.io/projected/9851e9c5-6eed-4f92-a46f-8c17945c6d5e-kube-api-access-zxtff\") pod \"model-serving-api-86f7b4b499-r9fgg\" (UID: \"9851e9c5-6eed-4f92-a46f-8c17945c6d5e\") " pod="kserve/model-serving-api-86f7b4b499-r9fgg"
May 20 15:42:24.971911 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.971834    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9851e9c5-6eed-4f92-a46f-8c17945c6d5e-tls-certs\") pod \"model-serving-api-86f7b4b499-r9fgg\" (UID: \"9851e9c5-6eed-4f92-a46f-8c17945c6d5e\") " pod="kserve/model-serving-api-86f7b4b499-r9fgg"
May 20 15:42:24.971911 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.971857    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/070df8d7-baf3-43b2-9ad2-5590351808bf-cert\") pod \"odh-model-controller-696fc77849-t5cf8\" (UID: \"070df8d7-baf3-43b2-9ad2-5590351808bf\") " pod="kserve/odh-model-controller-696fc77849-t5cf8"
May 20 15:42:24.974555 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.974529    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9851e9c5-6eed-4f92-a46f-8c17945c6d5e-tls-certs\") pod \"model-serving-api-86f7b4b499-r9fgg\" (UID: \"9851e9c5-6eed-4f92-a46f-8c17945c6d5e\") " pod="kserve/model-serving-api-86f7b4b499-r9fgg"
May 20 15:42:24.974652 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.974561    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/070df8d7-baf3-43b2-9ad2-5590351808bf-cert\") pod \"odh-model-controller-696fc77849-t5cf8\" (UID: \"070df8d7-baf3-43b2-9ad2-5590351808bf\") " pod="kserve/odh-model-controller-696fc77849-t5cf8"
May 20 15:42:24.981338 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.981319    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7q69\" (UniqueName: \"kubernetes.io/projected/070df8d7-baf3-43b2-9ad2-5590351808bf-kube-api-access-q7q69\") pod \"odh-model-controller-696fc77849-t5cf8\" (UID: \"070df8d7-baf3-43b2-9ad2-5590351808bf\") " pod="kserve/odh-model-controller-696fc77849-t5cf8"
May 20 15:42:24.981607 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:24.981586    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxtff\" (UniqueName: \"kubernetes.io/projected/9851e9c5-6eed-4f92-a46f-8c17945c6d5e-kube-api-access-zxtff\") pod \"model-serving-api-86f7b4b499-r9fgg\" (UID: \"9851e9c5-6eed-4f92-a46f-8c17945c6d5e\") " pod="kserve/model-serving-api-86f7b4b499-r9fgg"
May 20 15:42:25.045673 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:25.045618    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-r9fgg"
May 20 15:42:25.058326 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:25.058304    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-696fc77849-t5cf8"
May 20 15:42:25.182266 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:25.182216    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-r9fgg"]
May 20 15:42:25.186402 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:42:25.186371    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9851e9c5_6eed_4f92_a46f_8c17945c6d5e.slice/crio-51cc281be813b57f74ec76368a838914d7b84a687e0c798c7b6c868a281b11fd WatchSource:0}: Error finding container 51cc281be813b57f74ec76368a838914d7b84a687e0c798c7b6c868a281b11fd: Status 404 returned error can't find the container with id 51cc281be813b57f74ec76368a838914d7b84a687e0c798c7b6c868a281b11fd
May 20 15:42:25.203364 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:25.203344    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-696fc77849-t5cf8"]
May 20 15:42:25.205397 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:42:25.205377    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070df8d7_baf3_43b2_9ad2_5590351808bf.slice/crio-c00fe187815707fe501ec922d0b58b3c35c4875345d07dfc6eca013e7703fcff WatchSource:0}: Error finding container c00fe187815707fe501ec922d0b58b3c35c4875345d07dfc6eca013e7703fcff: Status 404 returned error can't find the container with id c00fe187815707fe501ec922d0b58b3c35c4875345d07dfc6eca013e7703fcff
May 20 15:42:25.498673 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:25.498641    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-696fc77849-t5cf8" event={"ID":"070df8d7-baf3-43b2-9ad2-5590351808bf","Type":"ContainerStarted","Data":"c00fe187815707fe501ec922d0b58b3c35c4875345d07dfc6eca013e7703fcff"}
May 20 15:42:25.499722 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:25.499695    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-r9fgg" event={"ID":"9851e9c5-6eed-4f92-a46f-8c17945c6d5e","Type":"ContainerStarted","Data":"51cc281be813b57f74ec76368a838914d7b84a687e0c798c7b6c868a281b11fd"}
May 20 15:42:29.513878 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:29.513767    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-696fc77849-t5cf8" event={"ID":"070df8d7-baf3-43b2-9ad2-5590351808bf","Type":"ContainerStarted","Data":"84bd54862b6d5a0bf2539a47d60a85d20044d662ac4c3b3367dcb488effd200a"}
May 20 15:42:29.513878 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:29.513868    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-696fc77849-t5cf8"
May 20 15:42:29.531046 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:29.515187    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-r9fgg" event={"ID":"9851e9c5-6eed-4f92-a46f-8c17945c6d5e","Type":"ContainerStarted","Data":"804189fdb36c23202b6f31891be96d3cb26637854b8c1f854ef7ed36fd9a8b11"}
May 20 15:42:29.531046 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:29.515230    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-86f7b4b499-r9fgg"
May 20 15:42:29.538414 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:29.538374    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/odh-model-controller-696fc77849-t5cf8" podStartSLOduration=1.910637013 podStartE2EDuration="5.538363697s" podCreationTimestamp="2026-05-20 15:42:24 +0000 UTC" firstStartedPulling="2026-05-20 15:42:25.206605833 +0000 UTC m=+636.080607552" lastFinishedPulling="2026-05-20 15:42:28.834332504 +0000 UTC m=+639.708334236" observedRunningTime="2026-05-20 15:42:29.537027608 +0000 UTC m=+640.411029357" watchObservedRunningTime="2026-05-20 15:42:29.538363697 +0000 UTC m=+640.412365434"
May 20 15:42:29.553955 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:29.553921    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/model-serving-api-86f7b4b499-r9fgg" podStartSLOduration=1.911576567 podStartE2EDuration="5.55391084s" podCreationTimestamp="2026-05-20 15:42:24 +0000 UTC" firstStartedPulling="2026-05-20 15:42:25.188135723 +0000 UTC m=+636.062137441" lastFinishedPulling="2026-05-20 15:42:28.830469978 +0000 UTC m=+639.704471714" observedRunningTime="2026-05-20 15:42:29.552980035 +0000 UTC m=+640.426981776" watchObservedRunningTime="2026-05-20 15:42:29.55391084 +0000 UTC m=+640.427912580"
May 20 15:42:40.520201 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:40.520163    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-696fc77849-t5cf8"
May 20 15:42:40.522073 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:42:40.522046    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-86f7b4b499-r9fgg"
May 20 15:43:04.517763 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.517728    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"]
May 20 15:43:04.524501 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.524477    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:04.527653 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.527629    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 20 15:43:04.527783 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.527627    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 20 15:43:04.527783 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.527669    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
May 20 15:43:04.529091 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.529040    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
May 20 15:43:04.529313 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.529042    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-sgm7r\""
May 20 15:43:04.531519 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.531495    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"]
May 20 15:43:04.657951 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.657926    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3d837f9-3a7c-4671-b758-5bac2d96320d-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:04.658077 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.657961    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3d837f9-3a7c-4671-b758-5bac2d96320d-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:04.658077 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.657981    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d3d837f9-3a7c-4671-b758-5bac2d96320d-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:04.658077 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.658023    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq8b8\" (UniqueName: \"kubernetes.io/projected/d3d837f9-3a7c-4671-b758-5bac2d96320d-kube-api-access-qq8b8\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:04.758298 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.758272    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3d837f9-3a7c-4671-b758-5bac2d96320d-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:04.758416 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.758302    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d3d837f9-3a7c-4671-b758-5bac2d96320d-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:04.758416 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.758336    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq8b8\" (UniqueName: \"kubernetes.io/projected/d3d837f9-3a7c-4671-b758-5bac2d96320d-kube-api-access-qq8b8\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:04.758416 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.758371    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3d837f9-3a7c-4671-b758-5bac2d96320d-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:04.758583 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:43:04.758463    2551 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
May 20 15:43:04.758583 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:43:04.758516    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d837f9-3a7c-4671-b758-5bac2d96320d-proxy-tls podName:d3d837f9-3a7c-4671-b758-5bac2d96320d nodeName:}" failed. No retries permitted until 2026-05-20 15:43:05.258498171 +0000 UTC m=+676.132499891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d3d837f9-3a7c-4671-b758-5bac2d96320d-proxy-tls") pod "isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" (UID: "d3d837f9-3a7c-4671-b758-5bac2d96320d") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
May 20 15:43:04.758702 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.758681    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3d837f9-3a7c-4671-b758-5bac2d96320d-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:04.758916 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.758899    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d3d837f9-3a7c-4671-b758-5bac2d96320d-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:04.773461 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:04.773403    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq8b8\" (UniqueName: \"kubernetes.io/projected/d3d837f9-3a7c-4671-b758-5bac2d96320d-kube-api-access-qq8b8\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:05.262997 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.262964    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3d837f9-3a7c-4671-b758-5bac2d96320d-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:05.265468 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.265442    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3d837f9-3a7c-4671-b758-5bac2d96320d-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6c6997cc58-829wc\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:05.436744 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.436711    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:05.524491 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.524460    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"]
May 20 15:43:05.527230 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.527215    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.531063 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.530895    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
May 20 15:43:05.531063 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.530959    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
May 20 15:43:05.541065 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.541042    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"]
May 20 15:43:05.571080 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.571057    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"]
May 20 15:43:05.573535 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:43:05.573500    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d837f9_3a7c_4671_b758_5bac2d96320d.slice/crio-baeef3564d9e6e9f2892d4e602cf75a879c5b0394617d2cfa16b139cf14235a7 WatchSource:0}: Error finding container baeef3564d9e6e9f2892d4e602cf75a879c5b0394617d2cfa16b139cf14235a7: Status 404 returned error can't find the container with id baeef3564d9e6e9f2892d4e602cf75a879c5b0394617d2cfa16b139cf14235a7
May 20 15:43:05.622577 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.622549    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" event={"ID":"d3d837f9-3a7c-4671-b758-5bac2d96320d","Type":"ContainerStarted","Data":"baeef3564d9e6e9f2892d4e602cf75a879c5b0394617d2cfa16b139cf14235a7"}
May 20 15:43:05.665960 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.665937    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b827a94d-93ca-4260-a3e6-3b3a429f8789-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.666073 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.665995    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6cb5\" (UniqueName: \"kubernetes.io/projected/b827a94d-93ca-4260-a3e6-3b3a429f8789-kube-api-access-c6cb5\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.666170 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.666077    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b827a94d-93ca-4260-a3e6-3b3a429f8789-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.666170 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.666163    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b827a94d-93ca-4260-a3e6-3b3a429f8789-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.767052 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.766992    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6cb5\" (UniqueName: \"kubernetes.io/projected/b827a94d-93ca-4260-a3e6-3b3a429f8789-kube-api-access-c6cb5\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.767052 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.767044    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b827a94d-93ca-4260-a3e6-3b3a429f8789-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.767233 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.767081    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b827a94d-93ca-4260-a3e6-3b3a429f8789-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.767233 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.767130    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b827a94d-93ca-4260-a3e6-3b3a429f8789-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.767495 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.767475    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b827a94d-93ca-4260-a3e6-3b3a429f8789-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.767835 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.767818    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b827a94d-93ca-4260-a3e6-3b3a429f8789-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.769683 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.769666    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b827a94d-93ca-4260-a3e6-3b3a429f8789-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.777228 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.777208    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6cb5\" (UniqueName: \"kubernetes.io/projected/b827a94d-93ca-4260-a3e6-3b3a429f8789-kube-api-access-c6cb5\") pod \"isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.840212 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.840190    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:05.988133 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:05.988064    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"]
May 20 15:43:05.993204 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:43:05.993172    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb827a94d_93ca_4260_a3e6_3b3a429f8789.slice/crio-31f8bd394ad7cff0231189033c7ad4532a267414f72915799df1cbfe9bf68c87 WatchSource:0}: Error finding container 31f8bd394ad7cff0231189033c7ad4532a267414f72915799df1cbfe9bf68c87: Status 404 returned error can't find the container with id 31f8bd394ad7cff0231189033c7ad4532a267414f72915799df1cbfe9bf68c87
May 20 15:43:06.627217 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:06.627176    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" event={"ID":"b827a94d-93ca-4260-a3e6-3b3a429f8789","Type":"ContainerStarted","Data":"31f8bd394ad7cff0231189033c7ad4532a267414f72915799df1cbfe9bf68c87"}
May 20 15:43:09.639179 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:09.639137    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" event={"ID":"d3d837f9-3a7c-4671-b758-5bac2d96320d","Type":"ContainerStarted","Data":"691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696"}
May 20 15:43:09.640417 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:09.640392    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" event={"ID":"b827a94d-93ca-4260-a3e6-3b3a429f8789","Type":"ContainerStarted","Data":"1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69"}
May 20 15:43:12.648977 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:12.648945    2551 generic.go:358] "Generic (PLEG): container finished" podID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerID="691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696" exitCode=0
May 20 15:43:12.649349 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:12.649016    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" event={"ID":"d3d837f9-3a7c-4671-b758-5bac2d96320d","Type":"ContainerDied","Data":"691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696"}
May 20 15:43:12.650346 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:12.650322    2551 generic.go:358] "Generic (PLEG): container finished" podID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerID="1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69" exitCode=0
May 20 15:43:12.650461 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:12.650386    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" event={"ID":"b827a94d-93ca-4260-a3e6-3b3a429f8789","Type":"ContainerDied","Data":"1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69"}
May 20 15:43:26.977086 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:26.977064    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 15:43:27.713531 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:27.713401    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" event={"ID":"d3d837f9-3a7c-4671-b758-5bac2d96320d","Type":"ContainerStarted","Data":"b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602"}
May 20 15:43:27.715801 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:27.715737    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" event={"ID":"b827a94d-93ca-4260-a3e6-3b3a429f8789","Type":"ContainerStarted","Data":"9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f"}
May 20 15:43:29.724132 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:29.723998    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" event={"ID":"b827a94d-93ca-4260-a3e6-3b3a429f8789","Type":"ContainerStarted","Data":"4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9"}
May 20 15:43:29.724564 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:29.724135    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:29.725951 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:29.725915    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" event={"ID":"d3d837f9-3a7c-4671-b758-5bac2d96320d","Type":"ContainerStarted","Data":"5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7"}
May 20 15:43:29.726156 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:29.726141    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:29.726156 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:29.726163    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:29.727775 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:29.727751    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
May 20 15:43:29.749557 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:29.749510    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podStartSLOduration=1.352657744 podStartE2EDuration="24.74949911s" podCreationTimestamp="2026-05-20 15:43:05 +0000 UTC" firstStartedPulling="2026-05-20 15:43:05.995589456 +0000 UTC m=+676.869591183" lastFinishedPulling="2026-05-20 15:43:29.392430829 +0000 UTC m=+700.266432549" observedRunningTime="2026-05-20 15:43:29.747707755 +0000 UTC m=+700.621709499" watchObservedRunningTime="2026-05-20 15:43:29.74949911 +0000 UTC m=+700.623500850"
May 20 15:43:29.769448 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:29.769407    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podStartSLOduration=1.955542544 podStartE2EDuration="25.769392977s" podCreationTimestamp="2026-05-20 15:43:04 +0000 UTC" firstStartedPulling="2026-05-20 15:43:05.575428343 +0000 UTC m=+676.449430061" lastFinishedPulling="2026-05-20 15:43:29.389278771 +0000 UTC m=+700.263280494" observedRunningTime="2026-05-20 15:43:29.768474684 +0000 UTC m=+700.642476430" watchObservedRunningTime="2026-05-20 15:43:29.769392977 +0000 UTC m=+700.643394719"
May 20 15:43:30.729408 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:30.729364    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
May 20 15:43:30.729779 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:30.729417    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:30.730353 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:30.730333    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
May 20 15:43:31.731301 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:31.731260    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
May 20 15:43:35.734284 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:35.734255    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:43:35.734860 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:35.734833    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
May 20 15:43:36.734931 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:36.734902    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:43:36.735507 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:36.735480    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
May 20 15:43:45.734744 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:45.734705    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
May 20 15:43:46.735374 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:46.735334    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
May 20 15:43:55.735355 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:55.735320    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
May 20 15:43:56.735900 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:43:56.735860    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
May 20 15:44:05.735333 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:44:05.735292    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
May 20 15:44:06.736129 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:44:06.736077    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
May 20 15:44:15.735414 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:44:15.735375    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
May 20 15:44:16.736226 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:44:16.736184    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
May 20 15:44:25.735303 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:44:25.735260    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
May 20 15:44:26.736269 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:44:26.736227    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
May 20 15:44:35.735308 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:44:35.735276    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:44:36.735914 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:44:36.735880    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:45:14.521394 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:14.521357    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"]
May 20 15:45:14.521897 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:14.521669    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container" containerID="cri-o://9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f" gracePeriod=30
May 20 15:45:14.521897 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:14.521714    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kube-rbac-proxy" containerID="cri-o://4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9" gracePeriod=30
May 20 15:45:14.591410 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:14.591383    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"]
May 20 15:45:14.591734 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:14.591710    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container" containerID="cri-o://b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602" gracePeriod=30
May 20 15:45:14.591798 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:14.591747    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kube-rbac-proxy" containerID="cri-o://5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7" gracePeriod=30
May 20 15:45:15.022188 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:15.022155    2551 generic.go:358] "Generic (PLEG): container finished" podID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerID="5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7" exitCode=2
May 20 15:45:15.022365 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:15.022238    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" event={"ID":"d3d837f9-3a7c-4671-b758-5bac2d96320d","Type":"ContainerDied","Data":"5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7"}
May 20 15:45:15.023853 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:15.023829    2551 generic.go:358] "Generic (PLEG): container finished" podID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerID="4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9" exitCode=2
May 20 15:45:15.023965 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:15.023901    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" event={"ID":"b827a94d-93ca-4260-a3e6-3b3a429f8789","Type":"ContainerDied","Data":"4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9"}
May 20 15:45:15.729779 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:15.729745    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.19:8643/healthz\": dial tcp 10.134.0.19:8643: connect: connection refused"
May 20 15:45:15.734714 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:15.734687    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.19:8080: connect: connection refused"
May 20 15:45:16.732320 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:16.732274    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.20:8643/healthz\": dial tcp 10.134.0.20:8643: connect: connection refused"
May 20 15:45:16.735876 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:16.735845    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.20:8080: connect: connection refused"
May 20 15:45:18.585037 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.585012    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:45:18.587980 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.587962    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:45:18.633783 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.633735    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d3d837f9-3a7c-4671-b758-5bac2d96320d-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\") pod \"d3d837f9-3a7c-4671-b758-5bac2d96320d\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") "
May 20 15:45:18.633783 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.633764    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3d837f9-3a7c-4671-b758-5bac2d96320d-proxy-tls\") pod \"d3d837f9-3a7c-4671-b758-5bac2d96320d\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") "
May 20 15:45:18.633939 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.633800    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq8b8\" (UniqueName: \"kubernetes.io/projected/d3d837f9-3a7c-4671-b758-5bac2d96320d-kube-api-access-qq8b8\") pod \"d3d837f9-3a7c-4671-b758-5bac2d96320d\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") "
May 20 15:45:18.633939 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.633832    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b827a94d-93ca-4260-a3e6-3b3a429f8789-kserve-provision-location\") pod \"b827a94d-93ca-4260-a3e6-3b3a429f8789\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") "
May 20 15:45:18.633939 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.633854    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b827a94d-93ca-4260-a3e6-3b3a429f8789-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"b827a94d-93ca-4260-a3e6-3b3a429f8789\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") "
May 20 15:45:18.633939 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.633874    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6cb5\" (UniqueName: \"kubernetes.io/projected/b827a94d-93ca-4260-a3e6-3b3a429f8789-kube-api-access-c6cb5\") pod \"b827a94d-93ca-4260-a3e6-3b3a429f8789\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") "
May 20 15:45:18.633939 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.633908    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b827a94d-93ca-4260-a3e6-3b3a429f8789-proxy-tls\") pod \"b827a94d-93ca-4260-a3e6-3b3a429f8789\" (UID: \"b827a94d-93ca-4260-a3e6-3b3a429f8789\") "
May 20 15:45:18.634209 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.634159    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b827a94d-93ca-4260-a3e6-3b3a429f8789-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "b827a94d-93ca-4260-a3e6-3b3a429f8789" (UID: "b827a94d-93ca-4260-a3e6-3b3a429f8789"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 15:45:18.634268 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.634228    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3d837f9-3a7c-4671-b758-5bac2d96320d-kserve-provision-location\") pod \"d3d837f9-3a7c-4671-b758-5bac2d96320d\" (UID: \"d3d837f9-3a7c-4671-b758-5bac2d96320d\") "
May 20 15:45:18.634315 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.634266    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b827a94d-93ca-4260-a3e6-3b3a429f8789-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-sklearn-graph-2-kube-rbac-proxy-sar-config") pod "b827a94d-93ca-4260-a3e6-3b3a429f8789" (UID: "b827a94d-93ca-4260-a3e6-3b3a429f8789"). InnerVolumeSpecName "isvc-sklearn-graph-2-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 15:45:18.634501 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.634453    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d837f9-3a7c-4671-b758-5bac2d96320d-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-sklearn-graph-1-kube-rbac-proxy-sar-config") pod "d3d837f9-3a7c-4671-b758-5bac2d96320d" (UID: "d3d837f9-3a7c-4671-b758-5bac2d96320d"). InnerVolumeSpecName "isvc-sklearn-graph-1-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 15:45:18.634501 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.634460    2551 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b827a94d-93ca-4260-a3e6-3b3a429f8789-kserve-provision-location\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 15:45:18.634622 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.634503    2551 reconciler_common.go:299] "Volume detached for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b827a94d-93ca-4260-a3e6-3b3a429f8789-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 15:45:18.634681 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.634554    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d837f9-3a7c-4671-b758-5bac2d96320d-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d3d837f9-3a7c-4671-b758-5bac2d96320d" (UID: "d3d837f9-3a7c-4671-b758-5bac2d96320d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 15:45:18.636096 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.636075    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3d837f9-3a7c-4671-b758-5bac2d96320d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d3d837f9-3a7c-4671-b758-5bac2d96320d" (UID: "d3d837f9-3a7c-4671-b758-5bac2d96320d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 15:45:18.636251 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.636125    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b827a94d-93ca-4260-a3e6-3b3a429f8789-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b827a94d-93ca-4260-a3e6-3b3a429f8789" (UID: "b827a94d-93ca-4260-a3e6-3b3a429f8789"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 15:45:18.636537 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.636511    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b827a94d-93ca-4260-a3e6-3b3a429f8789-kube-api-access-c6cb5" (OuterVolumeSpecName: "kube-api-access-c6cb5") pod "b827a94d-93ca-4260-a3e6-3b3a429f8789" (UID: "b827a94d-93ca-4260-a3e6-3b3a429f8789"). InnerVolumeSpecName "kube-api-access-c6cb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 15:45:18.636591 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.636566    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3d837f9-3a7c-4671-b758-5bac2d96320d-kube-api-access-qq8b8" (OuterVolumeSpecName: "kube-api-access-qq8b8") pod "d3d837f9-3a7c-4671-b758-5bac2d96320d" (UID: "d3d837f9-3a7c-4671-b758-5bac2d96320d"). InnerVolumeSpecName "kube-api-access-qq8b8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 15:45:18.735564 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.735541    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6cb5\" (UniqueName: \"kubernetes.io/projected/b827a94d-93ca-4260-a3e6-3b3a429f8789-kube-api-access-c6cb5\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 15:45:18.735564 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.735562    2551 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b827a94d-93ca-4260-a3e6-3b3a429f8789-proxy-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 15:45:18.735690 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.735571    2551 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3d837f9-3a7c-4671-b758-5bac2d96320d-kserve-provision-location\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 15:45:18.735690 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.735581    2551 reconciler_common.go:299] "Volume detached for volume \"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d3d837f9-3a7c-4671-b758-5bac2d96320d-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 15:45:18.735690 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.735604    2551 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3d837f9-3a7c-4671-b758-5bac2d96320d-proxy-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 15:45:18.735690 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:18.735613    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq8b8\" (UniqueName: \"kubernetes.io/projected/d3d837f9-3a7c-4671-b758-5bac2d96320d-kube-api-access-qq8b8\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 15:45:19.036348 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.036263    2551 generic.go:358] "Generic (PLEG): container finished" podID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerID="9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f" exitCode=0
May 20 15:45:19.036470 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.036355    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"
May 20 15:45:19.036470 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.036354    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" event={"ID":"b827a94d-93ca-4260-a3e6-3b3a429f8789","Type":"ContainerDied","Data":"9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f"}
May 20 15:45:19.036470 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.036399    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs" event={"ID":"b827a94d-93ca-4260-a3e6-3b3a429f8789","Type":"ContainerDied","Data":"31f8bd394ad7cff0231189033c7ad4532a267414f72915799df1cbfe9bf68c87"}
May 20 15:45:19.036470 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.036416    2551 scope.go:117] "RemoveContainer" containerID="4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9"
May 20 15:45:19.038303 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.038280    2551 generic.go:358] "Generic (PLEG): container finished" podID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerID="b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602" exitCode=0
May 20 15:45:19.038415 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.038321    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" event={"ID":"d3d837f9-3a7c-4671-b758-5bac2d96320d","Type":"ContainerDied","Data":"b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602"}
May 20 15:45:19.038415 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.038346    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc" event={"ID":"d3d837f9-3a7c-4671-b758-5bac2d96320d","Type":"ContainerDied","Data":"baeef3564d9e6e9f2892d4e602cf75a879c5b0394617d2cfa16b139cf14235a7"}
May 20 15:45:19.038415 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.038408    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"
May 20 15:45:19.044292 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.044277    2551 scope.go:117] "RemoveContainer" containerID="9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f"
May 20 15:45:19.051551 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.051532    2551 scope.go:117] "RemoveContainer" containerID="1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69"
May 20 15:45:19.058189 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.058174    2551 scope.go:117] "RemoveContainer" containerID="4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9"
May 20 15:45:19.058421 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:45:19.058405    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9\": container with ID starting with 4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9 not found: ID does not exist" containerID="4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9"
May 20 15:45:19.058469 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.058429    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9"} err="failed to get container status \"4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9\": rpc error: code = NotFound desc = could not find container \"4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9\": container with ID starting with 4a7cd07f994ba99a7cf4f8498e3e9e08df501e332586790ec047e05c79affce9 not found: ID does not exist"
May 20 15:45:19.058469 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.058443    2551 scope.go:117] "RemoveContainer" containerID="9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f"
May 20 15:45:19.058681 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:45:19.058660    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f\": container with ID starting with 9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f not found: ID does not exist" containerID="9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f"
May 20 15:45:19.058726 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.058686    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f"} err="failed to get container status \"9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f\": rpc error: code = NotFound desc = could not find container \"9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f\": container with ID starting with 9b2c889ced5a298b9e6cc3711ca2d1ec8049de25a30fb339f33151b4134ba82f not found: ID does not exist"
May 20 15:45:19.058726 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.058704    2551 scope.go:117] "RemoveContainer" containerID="1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69"
May 20 15:45:19.058917 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:45:19.058902    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69\": container with ID starting with 1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69 not found: ID does not exist" containerID="1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69"
May 20 15:45:19.058955 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.058922    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69"} err="failed to get container status \"1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69\": rpc error: code = NotFound desc = could not find container \"1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69\": container with ID starting with 1fe2f7d7d3b65c47e616030cb6a16a88ae1a66ac2ddef67b59818d3ccefceb69 not found: ID does not exist"
May 20 15:45:19.058955 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.058936    2551 scope.go:117] "RemoveContainer" containerID="5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7"
May 20 15:45:19.065434 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.065419    2551 scope.go:117] "RemoveContainer" containerID="b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602"
May 20 15:45:19.071932 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.071917    2551 scope.go:117] "RemoveContainer" containerID="691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696"
May 20 15:45:19.076827 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.076785    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"]
May 20 15:45:19.079717 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.079698    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-58b5c9bf58-tk8zs"]
May 20 15:45:19.079962 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.079945    2551 scope.go:117] "RemoveContainer" containerID="5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7"
May 20 15:45:19.080241 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:45:19.080219    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7\": container with ID starting with 5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7 not found: ID does not exist" containerID="5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7"
May 20 15:45:19.080324 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.080248    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7"} err="failed to get container status \"5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7\": rpc error: code = NotFound desc = could not find container \"5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7\": container with ID starting with 5c264619b52ca1912a3322cb1823eff4dc8e676cbca4b96baa81362b841659f7 not found: ID does not exist"
May 20 15:45:19.080324 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.080271    2551 scope.go:117] "RemoveContainer" containerID="b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602"
May 20 15:45:19.080498 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:45:19.080480    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602\": container with ID starting with b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602 not found: ID does not exist" containerID="b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602"
May 20 15:45:19.080542 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.080503    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602"} err="failed to get container status \"b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602\": rpc error: code = NotFound desc = could not find container \"b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602\": container with ID starting with b78f29a6aac519852bb7b195fafab8ae6d2df360b1fc0d17adf9f1f6c45b5602 not found: ID does not exist"
May 20 15:45:19.080542 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.080518    2551 scope.go:117] "RemoveContainer" containerID="691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696"
May 20 15:45:19.080728 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:45:19.080711    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696\": container with ID starting with 691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696 not found: ID does not exist" containerID="691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696"
May 20 15:45:19.080781 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.080734    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696"} err="failed to get container status \"691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696\": rpc error: code = NotFound desc = could not find container \"691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696\": container with ID starting with 691f895660ea30b9d02e098b208696eef7d1dbd36882bb06ec167a5d0d275696 not found: ID does not exist"
May 20 15:45:19.103017 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.102988    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"]
May 20 15:45:19.116035 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.116009    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6c6997cc58-829wc"]
May 20 15:45:19.691885 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.691828    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" path="/var/lib/kubelet/pods/b827a94d-93ca-4260-a3e6-3b3a429f8789/volumes"
May 20 15:45:19.692304 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:45:19.692290    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" path="/var/lib/kubelet/pods/d3d837f9-3a7c-4671-b758-5bac2d96320d/volumes"
May 20 15:56:49.804746 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.804718    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"]
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.804979    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.804989    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.804998    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="storage-initializer"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805003    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="storage-initializer"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805013    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="storage-initializer"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805019    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="storage-initializer"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805034    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kube-rbac-proxy"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805039    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kube-rbac-proxy"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805044    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kube-rbac-proxy"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805049    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kube-rbac-proxy"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805057    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805061    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805105    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kube-rbac-proxy"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805131    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kserve-container"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805138    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="b827a94d-93ca-4260-a3e6-3b3a429f8789" containerName="kserve-container"
May 20 15:56:49.805153 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.805143    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="d3d837f9-3a7c-4671-b758-5bac2d96320d" containerName="kube-rbac-proxy"
May 20 15:56:49.807768 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.807752    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 15:56:49.810403 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.810381    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-80b6e-serving-cert\""
May 20 15:56:49.810403 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.810396    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 20 15:56:49.810565 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.810397    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-80b6e-kube-rbac-proxy-sar-config\""
May 20 15:56:49.811560 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.811541    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-sgm7r\""
May 20 15:56:49.816521 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.816500    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"]
May 20 15:56:49.965985 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.965965    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-openshift-service-ca-bundle\") pod \"sequence-graph-80b6e-cd77b6b8-n7mpf\" (UID: \"33fa91a6-9459-488a-b32d-52f6bbdd4fcc\") " pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 15:56:49.966093 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:49.966012    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-proxy-tls\") pod \"sequence-graph-80b6e-cd77b6b8-n7mpf\" (UID: \"33fa91a6-9459-488a-b32d-52f6bbdd4fcc\") " pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 15:56:50.066642 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:50.066589    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-proxy-tls\") pod \"sequence-graph-80b6e-cd77b6b8-n7mpf\" (UID: \"33fa91a6-9459-488a-b32d-52f6bbdd4fcc\") " pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 15:56:50.066730 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:50.066646    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-openshift-service-ca-bundle\") pod \"sequence-graph-80b6e-cd77b6b8-n7mpf\" (UID: \"33fa91a6-9459-488a-b32d-52f6bbdd4fcc\") " pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 15:56:50.066774 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:56:50.066736    2551 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-80b6e-serving-cert: secret "sequence-graph-80b6e-serving-cert" not found
May 20 15:56:50.066819 ip-10-0-135-174 kubenswrapper[2551]: E0520 15:56:50.066798    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-proxy-tls podName:33fa91a6-9459-488a-b32d-52f6bbdd4fcc nodeName:}" failed. No retries permitted until 2026-05-20 15:56:50.566779193 +0000 UTC m=+1501.440780922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-proxy-tls") pod "sequence-graph-80b6e-cd77b6b8-n7mpf" (UID: "33fa91a6-9459-488a-b32d-52f6bbdd4fcc") : secret "sequence-graph-80b6e-serving-cert" not found
May 20 15:56:50.067203 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:50.067186    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-openshift-service-ca-bundle\") pod \"sequence-graph-80b6e-cd77b6b8-n7mpf\" (UID: \"33fa91a6-9459-488a-b32d-52f6bbdd4fcc\") " pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 15:56:50.570008 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:50.569980    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-proxy-tls\") pod \"sequence-graph-80b6e-cd77b6b8-n7mpf\" (UID: \"33fa91a6-9459-488a-b32d-52f6bbdd4fcc\") " pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 15:56:50.572602 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:50.572579    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-proxy-tls\") pod \"sequence-graph-80b6e-cd77b6b8-n7mpf\" (UID: \"33fa91a6-9459-488a-b32d-52f6bbdd4fcc\") " pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 15:56:50.717534 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:50.717496    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 15:56:50.848147 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:50.848077    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"]
May 20 15:56:50.850978 ip-10-0-135-174 kubenswrapper[2551]: W0520 15:56:50.850940    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33fa91a6_9459_488a_b32d_52f6bbdd4fcc.slice/crio-c9fc5a0f317fec33434bac2eae3c7cdf7c8ba5960436b86ce7c11e07d5ddcfda WatchSource:0}: Error finding container c9fc5a0f317fec33434bac2eae3c7cdf7c8ba5960436b86ce7c11e07d5ddcfda: Status 404 returned error can't find the container with id c9fc5a0f317fec33434bac2eae3c7cdf7c8ba5960436b86ce7c11e07d5ddcfda
May 20 15:56:50.852713 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:50.852697    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 15:56:50.991486 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:50.991453    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" event={"ID":"33fa91a6-9459-488a-b32d-52f6bbdd4fcc","Type":"ContainerStarted","Data":"c9fc5a0f317fec33434bac2eae3c7cdf7c8ba5960436b86ce7c11e07d5ddcfda"}
May 20 15:56:54.000608 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:54.000568    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" event={"ID":"33fa91a6-9459-488a-b32d-52f6bbdd4fcc","Type":"ContainerStarted","Data":"9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f"}
May 20 15:56:54.001031 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:54.000726    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 15:56:54.017949 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:56:54.017894    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" podStartSLOduration=2.886941632 podStartE2EDuration="5.017881697s" podCreationTimestamp="2026-05-20 15:56:49 +0000 UTC" firstStartedPulling="2026-05-20 15:56:50.852834608 +0000 UTC m=+1501.726836328" lastFinishedPulling="2026-05-20 15:56:52.983774671 +0000 UTC m=+1503.857776393" observedRunningTime="2026-05-20 15:56:54.017168206 +0000 UTC m=+1504.891169947" watchObservedRunningTime="2026-05-20 15:56:54.017881697 +0000 UTC m=+1504.891883438"
May 20 15:57:00.009833 ip-10-0-135-174 kubenswrapper[2551]: I0520 15:57:00.009760    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 16:05:04.559284 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:04.559250    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"]
May 20 16:05:04.559742 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:04.559473    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" podUID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" containerName="sequence-graph-80b6e" containerID="cri-o://9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f" gracePeriod=30
May 20 16:05:05.007896 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:05.007859    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" podUID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" containerName="sequence-graph-80b6e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:05:10.007454 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:10.007415    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" podUID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" containerName="sequence-graph-80b6e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:05:15.007588 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:15.007541    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" podUID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" containerName="sequence-graph-80b6e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:05:15.007975 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:15.007648    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 16:05:20.007063 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:20.007031    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" podUID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" containerName="sequence-graph-80b6e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:05:25.007263 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:25.007221    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" podUID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" containerName="sequence-graph-80b6e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:05:30.007237 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:30.007201    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" podUID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" containerName="sequence-graph-80b6e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:05:34.699178 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:34.699152    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 16:05:34.790061 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:34.790032    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-proxy-tls\") pod \"33fa91a6-9459-488a-b32d-52f6bbdd4fcc\" (UID: \"33fa91a6-9459-488a-b32d-52f6bbdd4fcc\") "
May 20 16:05:34.790219 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:34.790088    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-openshift-service-ca-bundle\") pod \"33fa91a6-9459-488a-b32d-52f6bbdd4fcc\" (UID: \"33fa91a6-9459-488a-b32d-52f6bbdd4fcc\") "
May 20 16:05:34.790367 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:34.790344    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "33fa91a6-9459-488a-b32d-52f6bbdd4fcc" (UID: "33fa91a6-9459-488a-b32d-52f6bbdd4fcc"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 16:05:34.792172 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:34.792152    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "33fa91a6-9459-488a-b32d-52f6bbdd4fcc" (UID: "33fa91a6-9459-488a-b32d-52f6bbdd4fcc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 16:05:34.890755 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:34.890730    2551 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-proxy-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 16:05:34.890755 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:34.890753    2551 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33fa91a6-9459-488a-b32d-52f6bbdd4fcc-openshift-service-ca-bundle\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 16:05:35.495631 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:35.495595    2551 generic.go:358] "Generic (PLEG): container finished" podID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" containerID="9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f" exitCode=137
May 20 16:05:35.495781 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:35.495647    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" event={"ID":"33fa91a6-9459-488a-b32d-52f6bbdd4fcc","Type":"ContainerDied","Data":"9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f"}
May 20 16:05:35.495781 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:35.495673    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf" event={"ID":"33fa91a6-9459-488a-b32d-52f6bbdd4fcc","Type":"ContainerDied","Data":"c9fc5a0f317fec33434bac2eae3c7cdf7c8ba5960436b86ce7c11e07d5ddcfda"}
May 20 16:05:35.495781 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:35.495673    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"
May 20 16:05:35.495781 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:35.495689    2551 scope.go:117] "RemoveContainer" containerID="9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f"
May 20 16:05:35.505166 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:35.505142    2551 scope.go:117] "RemoveContainer" containerID="9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f"
May 20 16:05:35.505441 ip-10-0-135-174 kubenswrapper[2551]: E0520 16:05:35.505417    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f\": container with ID starting with 9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f not found: ID does not exist" containerID="9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f"
May 20 16:05:35.505511 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:35.505454    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f"} err="failed to get container status \"9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f\": rpc error: code = NotFound desc = could not find container \"9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f\": container with ID starting with 9b47c7180ca9849c4b6c80f9a11b42d129284160559dd1e240ddb31d43486c7f not found: ID does not exist"
May 20 16:05:35.517710 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:35.517675    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"]
May 20 16:05:35.521509 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:35.521480    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-80b6e-cd77b6b8-n7mpf"]
May 20 16:05:35.692249 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:35.692211    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" path="/var/lib/kubelet/pods/33fa91a6-9459-488a-b32d-52f6bbdd4fcc/volumes"
May 20 16:05:59.161426 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.161393    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"]
May 20 16:05:59.161798 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.161683    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" containerName="sequence-graph-80b6e"
May 20 16:05:59.161798 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.161694    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" containerName="sequence-graph-80b6e"
May 20 16:05:59.161798 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.161762    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="33fa91a6-9459-488a-b32d-52f6bbdd4fcc" containerName="sequence-graph-80b6e"
May 20 16:05:59.163581 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.163563    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:05:59.169069 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.169052    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 20 16:05:59.169290 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.169269    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-sgm7r\""
May 20 16:05:59.170080 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.170061    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-e05eb-serving-cert\""
May 20 16:05:59.170188 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.170062    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-e05eb-kube-rbac-proxy-sar-config\""
May 20 16:05:59.193348 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.193329    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"]
May 20 16:05:59.259355 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.259329    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-openshift-service-ca-bundle\") pod \"splitter-graph-e05eb-5b84678cc8-ktfv6\" (UID: \"a1234a3a-7afc-43d7-a3b6-fd0266f388f4\") " pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:05:59.259457 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.259371    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-proxy-tls\") pod \"splitter-graph-e05eb-5b84678cc8-ktfv6\" (UID: \"a1234a3a-7afc-43d7-a3b6-fd0266f388f4\") " pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:05:59.360307 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.360287    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-openshift-service-ca-bundle\") pod \"splitter-graph-e05eb-5b84678cc8-ktfv6\" (UID: \"a1234a3a-7afc-43d7-a3b6-fd0266f388f4\") " pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:05:59.360432 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.360326    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-proxy-tls\") pod \"splitter-graph-e05eb-5b84678cc8-ktfv6\" (UID: \"a1234a3a-7afc-43d7-a3b6-fd0266f388f4\") " pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:05:59.360497 ip-10-0-135-174 kubenswrapper[2551]: E0520 16:05:59.360449    2551 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-e05eb-serving-cert: secret "splitter-graph-e05eb-serving-cert" not found
May 20 16:05:59.360548 ip-10-0-135-174 kubenswrapper[2551]: E0520 16:05:59.360511    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-proxy-tls podName:a1234a3a-7afc-43d7-a3b6-fd0266f388f4 nodeName:}" failed. No retries permitted until 2026-05-20 16:05:59.860495148 +0000 UTC m=+2050.734496880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-proxy-tls") pod "splitter-graph-e05eb-5b84678cc8-ktfv6" (UID: "a1234a3a-7afc-43d7-a3b6-fd0266f388f4") : secret "splitter-graph-e05eb-serving-cert" not found
May 20 16:05:59.360935 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.360915    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-openshift-service-ca-bundle\") pod \"splitter-graph-e05eb-5b84678cc8-ktfv6\" (UID: \"a1234a3a-7afc-43d7-a3b6-fd0266f388f4\") " pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:05:59.863733 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.863701    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-proxy-tls\") pod \"splitter-graph-e05eb-5b84678cc8-ktfv6\" (UID: \"a1234a3a-7afc-43d7-a3b6-fd0266f388f4\") " pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:05:59.866636 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:05:59.866606    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-proxy-tls\") pod \"splitter-graph-e05eb-5b84678cc8-ktfv6\" (UID: \"a1234a3a-7afc-43d7-a3b6-fd0266f388f4\") " pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:06:00.073400 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:00.073381    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:06:00.205603 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:00.205570    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"]
May 20 16:06:00.208460 ip-10-0-135-174 kubenswrapper[2551]: W0520 16:06:00.208430    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1234a3a_7afc_43d7_a3b6_fd0266f388f4.slice/crio-350ecaf230408319c64e3cea8b1e00795eb01da797cdba508109876ddd46d119 WatchSource:0}: Error finding container 350ecaf230408319c64e3cea8b1e00795eb01da797cdba508109876ddd46d119: Status 404 returned error can't find the container with id 350ecaf230408319c64e3cea8b1e00795eb01da797cdba508109876ddd46d119
May 20 16:06:00.210179 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:00.210159    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 16:06:00.569428 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:00.569352    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" event={"ID":"a1234a3a-7afc-43d7-a3b6-fd0266f388f4","Type":"ContainerStarted","Data":"8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76"}
May 20 16:06:00.569428 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:00.569389    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" event={"ID":"a1234a3a-7afc-43d7-a3b6-fd0266f388f4","Type":"ContainerStarted","Data":"350ecaf230408319c64e3cea8b1e00795eb01da797cdba508109876ddd46d119"}
May 20 16:06:00.569593 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:00.569486    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:06:06.579345 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:06.579318    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:06:06.599681 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:06.599631    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" podStartSLOduration=7.5996204469999995 podStartE2EDuration="7.599620447s" podCreationTimestamp="2026-05-20 16:05:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 16:06:00.609750368 +0000 UTC m=+2051.483752108" watchObservedRunningTime="2026-05-20 16:06:06.599620447 +0000 UTC m=+2057.473622188"
May 20 16:06:09.153179 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:09.153151    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"]
May 20 16:06:09.153552 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:09.153356    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" podUID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" containerName="splitter-graph-e05eb" containerID="cri-o://8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76" gracePeriod=30
May 20 16:06:11.576400 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:11.576352    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" podUID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" containerName="splitter-graph-e05eb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:06:14.854099 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:14.854067    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"]
May 20 16:06:14.856154 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:14.856136    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:06:14.859657 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:14.859629    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-fd7d8-serving-cert\""
May 20 16:06:14.859783 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:14.859657    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-fd7d8-kube-rbac-proxy-sar-config\""
May 20 16:06:14.870313 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:14.870288    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"]
May 20 16:06:14.964340 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:14.964321    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a25f8c77-2139-46a5-8076-c5d47ce1a644-proxy-tls\") pod \"switch-graph-fd7d8-5949c54b67-xjpls\" (UID: \"a25f8c77-2139-46a5-8076-c5d47ce1a644\") " pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:06:14.964450 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:14.964356    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25f8c77-2139-46a5-8076-c5d47ce1a644-openshift-service-ca-bundle\") pod \"switch-graph-fd7d8-5949c54b67-xjpls\" (UID: \"a25f8c77-2139-46a5-8076-c5d47ce1a644\") " pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:06:15.064870 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:15.064845    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a25f8c77-2139-46a5-8076-c5d47ce1a644-proxy-tls\") pod \"switch-graph-fd7d8-5949c54b67-xjpls\" (UID: \"a25f8c77-2139-46a5-8076-c5d47ce1a644\") " pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:06:15.064968 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:15.064879    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25f8c77-2139-46a5-8076-c5d47ce1a644-openshift-service-ca-bundle\") pod \"switch-graph-fd7d8-5949c54b67-xjpls\" (UID: \"a25f8c77-2139-46a5-8076-c5d47ce1a644\") " pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:06:15.065018 ip-10-0-135-174 kubenswrapper[2551]: E0520 16:06:15.064978    2551 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-fd7d8-serving-cert: secret "switch-graph-fd7d8-serving-cert" not found
May 20 16:06:15.065054 ip-10-0-135-174 kubenswrapper[2551]: E0520 16:06:15.065045    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25f8c77-2139-46a5-8076-c5d47ce1a644-proxy-tls podName:a25f8c77-2139-46a5-8076-c5d47ce1a644 nodeName:}" failed. No retries permitted until 2026-05-20 16:06:15.565027799 +0000 UTC m=+2066.439029532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a25f8c77-2139-46a5-8076-c5d47ce1a644-proxy-tls") pod "switch-graph-fd7d8-5949c54b67-xjpls" (UID: "a25f8c77-2139-46a5-8076-c5d47ce1a644") : secret "switch-graph-fd7d8-serving-cert" not found
May 20 16:06:15.065424 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:15.065409    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25f8c77-2139-46a5-8076-c5d47ce1a644-openshift-service-ca-bundle\") pod \"switch-graph-fd7d8-5949c54b67-xjpls\" (UID: \"a25f8c77-2139-46a5-8076-c5d47ce1a644\") " pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:06:15.568269 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:15.568223    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a25f8c77-2139-46a5-8076-c5d47ce1a644-proxy-tls\") pod \"switch-graph-fd7d8-5949c54b67-xjpls\" (UID: \"a25f8c77-2139-46a5-8076-c5d47ce1a644\") " pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:06:15.570802 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:15.570778    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a25f8c77-2139-46a5-8076-c5d47ce1a644-proxy-tls\") pod \"switch-graph-fd7d8-5949c54b67-xjpls\" (UID: \"a25f8c77-2139-46a5-8076-c5d47ce1a644\") " pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:06:15.766165 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:15.766135    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:06:15.900232 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:15.900201    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"]
May 20 16:06:15.904473 ip-10-0-135-174 kubenswrapper[2551]: W0520 16:06:15.904442    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25f8c77_2139_46a5_8076_c5d47ce1a644.slice/crio-488b0edcc26d12f5bdebbf02dc90879d4f4bc62f8a8439dd5555b980438900cf WatchSource:0}: Error finding container 488b0edcc26d12f5bdebbf02dc90879d4f4bc62f8a8439dd5555b980438900cf: Status 404 returned error can't find the container with id 488b0edcc26d12f5bdebbf02dc90879d4f4bc62f8a8439dd5555b980438900cf
May 20 16:06:16.576571 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:16.576532    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" podUID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" containerName="splitter-graph-e05eb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:06:16.618364 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:16.618329    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" event={"ID":"a25f8c77-2139-46a5-8076-c5d47ce1a644","Type":"ContainerStarted","Data":"845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446"}
May 20 16:06:16.618364 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:16.618364    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" event={"ID":"a25f8c77-2139-46a5-8076-c5d47ce1a644","Type":"ContainerStarted","Data":"488b0edcc26d12f5bdebbf02dc90879d4f4bc62f8a8439dd5555b980438900cf"}
May 20 16:06:16.618571 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:16.618462    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:06:16.635040 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:16.634990    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" podStartSLOduration=2.634977542 podStartE2EDuration="2.634977542s" podCreationTimestamp="2026-05-20 16:06:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 16:06:16.63448252 +0000 UTC m=+2067.508484260" watchObservedRunningTime="2026-05-20 16:06:16.634977542 +0000 UTC m=+2067.508979283"
May 20 16:06:21.575849 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:21.575814    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" podUID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" containerName="splitter-graph-e05eb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:06:21.576225 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:21.575904    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:06:22.628324 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:22.628295    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:06:26.576674 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:26.576627    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" podUID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" containerName="splitter-graph-e05eb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:06:31.576491 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:31.576443    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" podUID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" containerName="splitter-graph-e05eb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:06:36.576850 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:36.576805    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" podUID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" containerName="splitter-graph-e05eb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:06:39.329834 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.329808    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:06:39.430377 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.430310    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-proxy-tls\") pod \"a1234a3a-7afc-43d7-a3b6-fd0266f388f4\" (UID: \"a1234a3a-7afc-43d7-a3b6-fd0266f388f4\") "
May 20 16:06:39.430505 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.430376    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-openshift-service-ca-bundle\") pod \"a1234a3a-7afc-43d7-a3b6-fd0266f388f4\" (UID: \"a1234a3a-7afc-43d7-a3b6-fd0266f388f4\") "
May 20 16:06:39.430744 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.430723    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a1234a3a-7afc-43d7-a3b6-fd0266f388f4" (UID: "a1234a3a-7afc-43d7-a3b6-fd0266f388f4"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 16:06:39.432495 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.432473    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a1234a3a-7afc-43d7-a3b6-fd0266f388f4" (UID: "a1234a3a-7afc-43d7-a3b6-fd0266f388f4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 16:06:39.531105 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.531079    2551 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-openshift-service-ca-bundle\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 16:06:39.531105 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.531104    2551 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a1234a3a-7afc-43d7-a3b6-fd0266f388f4-proxy-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 16:06:39.688250 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.688180    2551 generic.go:358] "Generic (PLEG): container finished" podID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" containerID="8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76" exitCode=0
May 20 16:06:39.689179 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.689159    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"
May 20 16:06:39.691496 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.691456    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" event={"ID":"a1234a3a-7afc-43d7-a3b6-fd0266f388f4","Type":"ContainerDied","Data":"8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76"}
May 20 16:06:39.691605 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.691500    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6" event={"ID":"a1234a3a-7afc-43d7-a3b6-fd0266f388f4","Type":"ContainerDied","Data":"350ecaf230408319c64e3cea8b1e00795eb01da797cdba508109876ddd46d119"}
May 20 16:06:39.691605 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.691517    2551 scope.go:117] "RemoveContainer" containerID="8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76"
May 20 16:06:39.699857 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.699831    2551 scope.go:117] "RemoveContainer" containerID="8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76"
May 20 16:06:39.700346 ip-10-0-135-174 kubenswrapper[2551]: E0520 16:06:39.700318    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76\": container with ID starting with 8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76 not found: ID does not exist" containerID="8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76"
May 20 16:06:39.700429 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.700358    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76"} err="failed to get container status \"8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76\": rpc error: code = NotFound desc = could not find container \"8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76\": container with ID starting with 8bf9caf01eff6f3bd9e5892ff9601935be74501a77d5c0cd0806e531c2f7ad76 not found: ID does not exist"
May 20 16:06:39.713687 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.713664    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"]
May 20 16:06:39.719587 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:39.719567    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e05eb-5b84678cc8-ktfv6"]
May 20 16:06:41.692312 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:06:41.692275    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" path="/var/lib/kubelet/pods/a1234a3a-7afc-43d7-a3b6-fd0266f388f4/volumes"
May 20 16:07:09.423150 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.423095    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"]
May 20 16:07:09.423596 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.423525    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" containerName="splitter-graph-e05eb"
May 20 16:07:09.423596 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.423542    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" containerName="splitter-graph-e05eb"
May 20 16:07:09.423721 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.423634    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1234a3a-7afc-43d7-a3b6-fd0266f388f4" containerName="splitter-graph-e05eb"
May 20 16:07:09.425981 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.425959    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:07:09.428797 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.428772    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-62c44-kube-rbac-proxy-sar-config\""
May 20 16:07:09.428892 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.428868    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-62c44-serving-cert\""
May 20 16:07:09.435417 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.435397    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"]
May 20 16:07:09.536670 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.536647    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/327197d7-c7e5-4bf7-a815-b263d14b655f-proxy-tls\") pod \"splitter-graph-62c44-6586f8b5bc-lm5g9\" (UID: \"327197d7-c7e5-4bf7-a815-b263d14b655f\") " pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:07:09.536759 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.536687    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/327197d7-c7e5-4bf7-a815-b263d14b655f-openshift-service-ca-bundle\") pod \"splitter-graph-62c44-6586f8b5bc-lm5g9\" (UID: \"327197d7-c7e5-4bf7-a815-b263d14b655f\") " pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:07:09.637506 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.637480    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/327197d7-c7e5-4bf7-a815-b263d14b655f-openshift-service-ca-bundle\") pod \"splitter-graph-62c44-6586f8b5bc-lm5g9\" (UID: \"327197d7-c7e5-4bf7-a815-b263d14b655f\") " pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:07:09.637608 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.637534    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/327197d7-c7e5-4bf7-a815-b263d14b655f-proxy-tls\") pod \"splitter-graph-62c44-6586f8b5bc-lm5g9\" (UID: \"327197d7-c7e5-4bf7-a815-b263d14b655f\") " pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:07:09.638152 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.638098    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/327197d7-c7e5-4bf7-a815-b263d14b655f-openshift-service-ca-bundle\") pod \"splitter-graph-62c44-6586f8b5bc-lm5g9\" (UID: \"327197d7-c7e5-4bf7-a815-b263d14b655f\") " pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:07:09.640002 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.639984    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/327197d7-c7e5-4bf7-a815-b263d14b655f-proxy-tls\") pod \"splitter-graph-62c44-6586f8b5bc-lm5g9\" (UID: \"327197d7-c7e5-4bf7-a815-b263d14b655f\") " pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:07:09.736575 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.736521    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:07:09.861273 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:09.861230    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"]
May 20 16:07:09.863436 ip-10-0-135-174 kubenswrapper[2551]: W0520 16:07:09.863411    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod327197d7_c7e5_4bf7_a815_b263d14b655f.slice/crio-963a952df44ad3972b2aacbe946336a47b0f62715229bc052ecb037c41d5729a WatchSource:0}: Error finding container 963a952df44ad3972b2aacbe946336a47b0f62715229bc052ecb037c41d5729a: Status 404 returned error can't find the container with id 963a952df44ad3972b2aacbe946336a47b0f62715229bc052ecb037c41d5729a
May 20 16:07:10.783861 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:10.783815    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" event={"ID":"327197d7-c7e5-4bf7-a815-b263d14b655f","Type":"ContainerStarted","Data":"e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335"}
May 20 16:07:10.783861 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:10.783863    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" event={"ID":"327197d7-c7e5-4bf7-a815-b263d14b655f","Type":"ContainerStarted","Data":"963a952df44ad3972b2aacbe946336a47b0f62715229bc052ecb037c41d5729a"}
May 20 16:07:10.784408 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:10.783963    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:07:10.802047 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:10.802000    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" podStartSLOduration=1.8019871809999999 podStartE2EDuration="1.801987181s" podCreationTimestamp="2026-05-20 16:07:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 16:07:10.800853478 +0000 UTC m=+2121.674855220" watchObservedRunningTime="2026-05-20 16:07:10.801987181 +0000 UTC m=+2121.675988922"
May 20 16:07:16.792171 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:07:16.792132    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:15:24.090558 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:24.090480    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"]
May 20 16:15:24.092868 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:24.090739    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" podUID="327197d7-c7e5-4bf7-a815-b263d14b655f" containerName="splitter-graph-62c44" containerID="cri-o://e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335" gracePeriod=30
May 20 16:15:26.790519 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:26.790487    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" podUID="327197d7-c7e5-4bf7-a815-b263d14b655f" containerName="splitter-graph-62c44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:15:31.790749 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:31.790700    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" podUID="327197d7-c7e5-4bf7-a815-b263d14b655f" containerName="splitter-graph-62c44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:15:36.790442 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:36.790404    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" podUID="327197d7-c7e5-4bf7-a815-b263d14b655f" containerName="splitter-graph-62c44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:15:36.790910 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:36.790515    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:15:41.790692 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:41.790651    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" podUID="327197d7-c7e5-4bf7-a815-b263d14b655f" containerName="splitter-graph-62c44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:15:46.790465 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:46.790418    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" podUID="327197d7-c7e5-4bf7-a815-b263d14b655f" containerName="splitter-graph-62c44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:15:51.790545 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:51.790503    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" podUID="327197d7-c7e5-4bf7-a815-b263d14b655f" containerName="splitter-graph-62c44" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:15:54.236705 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.236681    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:15:54.274860 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.274835    2551 generic.go:358] "Generic (PLEG): container finished" podID="327197d7-c7e5-4bf7-a815-b263d14b655f" containerID="e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335" exitCode=0
May 20 16:15:54.274968 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.274891    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"
May 20 16:15:54.274968 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.274920    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" event={"ID":"327197d7-c7e5-4bf7-a815-b263d14b655f","Type":"ContainerDied","Data":"e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335"}
May 20 16:15:54.274968 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.274961    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9" event={"ID":"327197d7-c7e5-4bf7-a815-b263d14b655f","Type":"ContainerDied","Data":"963a952df44ad3972b2aacbe946336a47b0f62715229bc052ecb037c41d5729a"}
May 20 16:15:54.275074 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.274977    2551 scope.go:117] "RemoveContainer" containerID="e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335"
May 20 16:15:54.282620 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.282600    2551 scope.go:117] "RemoveContainer" containerID="e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335"
May 20 16:15:54.282890 ip-10-0-135-174 kubenswrapper[2551]: E0520 16:15:54.282873    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335\": container with ID starting with e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335 not found: ID does not exist" containerID="e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335"
May 20 16:15:54.282956 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.282903    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335"} err="failed to get container status \"e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335\": rpc error: code = NotFound desc = could not find container \"e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335\": container with ID starting with e54ed0c57526aef919d34cca22ae1966514ba0cbb07222979a235c723007a335 not found: ID does not exist"
May 20 16:15:54.326730 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.326709    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/327197d7-c7e5-4bf7-a815-b263d14b655f-proxy-tls\") pod \"327197d7-c7e5-4bf7-a815-b263d14b655f\" (UID: \"327197d7-c7e5-4bf7-a815-b263d14b655f\") "
May 20 16:15:54.326844 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.326742    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/327197d7-c7e5-4bf7-a815-b263d14b655f-openshift-service-ca-bundle\") pod \"327197d7-c7e5-4bf7-a815-b263d14b655f\" (UID: \"327197d7-c7e5-4bf7-a815-b263d14b655f\") "
May 20 16:15:54.327136 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.327089    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/327197d7-c7e5-4bf7-a815-b263d14b655f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "327197d7-c7e5-4bf7-a815-b263d14b655f" (UID: "327197d7-c7e5-4bf7-a815-b263d14b655f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 16:15:54.328779 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.328745    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/327197d7-c7e5-4bf7-a815-b263d14b655f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "327197d7-c7e5-4bf7-a815-b263d14b655f" (UID: "327197d7-c7e5-4bf7-a815-b263d14b655f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 16:15:54.427800 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.427753    2551 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/327197d7-c7e5-4bf7-a815-b263d14b655f-openshift-service-ca-bundle\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 16:15:54.427800 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.427772    2551 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/327197d7-c7e5-4bf7-a815-b263d14b655f-proxy-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 16:15:54.595712 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.595689    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"]
May 20 16:15:54.601320 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:54.601298    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-62c44-6586f8b5bc-lm5g9"]
May 20 16:15:55.692505 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:15:55.692468    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="327197d7-c7e5-4bf7-a815-b263d14b655f" path="/var/lib/kubelet/pods/327197d7-c7e5-4bf7-a815-b263d14b655f/volumes"
May 20 16:22:34.114148 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:34.114048    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"]
May 20 16:22:34.114658 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:34.114331    2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" podUID="a25f8c77-2139-46a5-8076-c5d47ce1a644" containerName="switch-graph-fd7d8" containerID="cri-o://845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446" gracePeriod=30
May 20 16:22:37.626036 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:37.625998    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" podUID="a25f8c77-2139-46a5-8076-c5d47ce1a644" containerName="switch-graph-fd7d8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:22:42.625687 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:42.625651    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" podUID="a25f8c77-2139-46a5-8076-c5d47ce1a644" containerName="switch-graph-fd7d8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:22:47.626161 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:47.626095    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" podUID="a25f8c77-2139-46a5-8076-c5d47ce1a644" containerName="switch-graph-fd7d8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:22:47.626562 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:47.626230    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:22:51.624295 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:51.624254    2551 ???:1] "http2: server: error reading preface from client 10.0.135.174:45348: read tcp 10.0.135.174:10250->10.0.135.174:45348: read: connection reset by peer"
May 20 16:22:51.628558 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:51.628530    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:22:52.458612 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:52.458586    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:22:52.625967 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:52.625937    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" podUID="a25f8c77-2139-46a5-8076-c5d47ce1a644" containerName="switch-graph-fd7d8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:22:53.292426 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:53.292387    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:22:54.197559 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:54.197512    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:22:55.012251 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:55.012218    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:22:55.812059 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:55.812023    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:22:56.611938 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:56.611905    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:22:57.444323 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:57.444288    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:22:57.626036 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:57.625996    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" podUID="a25f8c77-2139-46a5-8076-c5d47ce1a644" containerName="switch-graph-fd7d8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:22:58.247844 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:58.247820    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:22:59.055537 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:59.055512    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:22:59.862067 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:22:59.862038    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:23:00.685402 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:00.685355    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-fd7d8-5949c54b67-xjpls_a25f8c77-2139-46a5-8076-c5d47ce1a644/switch-graph-fd7d8/0.log"
May 20 16:23:02.625418 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:02.625379    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" podUID="a25f8c77-2139-46a5-8076-c5d47ce1a644" containerName="switch-graph-fd7d8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 16:23:04.256032 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.256001    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:23:04.400741 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.400662    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a25f8c77-2139-46a5-8076-c5d47ce1a644-proxy-tls\") pod \"a25f8c77-2139-46a5-8076-c5d47ce1a644\" (UID: \"a25f8c77-2139-46a5-8076-c5d47ce1a644\") "
May 20 16:23:04.400741 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.400708    2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25f8c77-2139-46a5-8076-c5d47ce1a644-openshift-service-ca-bundle\") pod \"a25f8c77-2139-46a5-8076-c5d47ce1a644\" (UID: \"a25f8c77-2139-46a5-8076-c5d47ce1a644\") "
May 20 16:23:04.401100 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.401075    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a25f8c77-2139-46a5-8076-c5d47ce1a644-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a25f8c77-2139-46a5-8076-c5d47ce1a644" (UID: "a25f8c77-2139-46a5-8076-c5d47ce1a644"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 16:23:04.402725 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.402706    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a25f8c77-2139-46a5-8076-c5d47ce1a644-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a25f8c77-2139-46a5-8076-c5d47ce1a644" (UID: "a25f8c77-2139-46a5-8076-c5d47ce1a644"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 16:23:04.477261 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.477235    2551 generic.go:358] "Generic (PLEG): container finished" podID="a25f8c77-2139-46a5-8076-c5d47ce1a644" containerID="845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446" exitCode=0
May 20 16:23:04.477350 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.477288    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" event={"ID":"a25f8c77-2139-46a5-8076-c5d47ce1a644","Type":"ContainerDied","Data":"845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446"}
May 20 16:23:04.477350 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.477297    2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"
May 20 16:23:04.477350 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.477313    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls" event={"ID":"a25f8c77-2139-46a5-8076-c5d47ce1a644","Type":"ContainerDied","Data":"488b0edcc26d12f5bdebbf02dc90879d4f4bc62f8a8439dd5555b980438900cf"}
May 20 16:23:04.477350 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.477329    2551 scope.go:117] "RemoveContainer" containerID="845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446"
May 20 16:23:04.485693 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.485677    2551 scope.go:117] "RemoveContainer" containerID="845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446"
May 20 16:23:04.485935 ip-10-0-135-174 kubenswrapper[2551]: E0520 16:23:04.485919    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446\": container with ID starting with 845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446 not found: ID does not exist" containerID="845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446"
May 20 16:23:04.485978 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.485944    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446"} err="failed to get container status \"845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446\": rpc error: code = NotFound desc = could not find container \"845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446\": container with ID starting with 845a4fd53bb4271683186f3e5a32f4cb2d0dc405e628ffe5393c3d48895e9446 not found: ID does not exist"
May 20 16:23:04.499382 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.499361    2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"]
May 20 16:23:04.501334 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.501319    2551 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a25f8c77-2139-46a5-8076-c5d47ce1a644-proxy-tls\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 16:23:04.501387 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.501339    2551 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25f8c77-2139-46a5-8076-c5d47ce1a644-openshift-service-ca-bundle\") on node \"ip-10-0-135-174.ec2.internal\" DevicePath \"\""
May 20 16:23:04.504610 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:04.504589    2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-fd7d8-5949c54b67-xjpls"]
May 20 16:23:05.691996 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:05.691954    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a25f8c77-2139-46a5-8076-c5d47ce1a644" path="/var/lib/kubelet/pods/a25f8c77-2139-46a5-8076-c5d47ce1a644/volumes"
May 20 16:23:09.578574 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:09.578539    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dhv8s_e3204c49-b248-4926-8e83-996e825134ad/global-pull-secret-syncer/0.log"
May 20 16:23:09.735169 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:09.735135    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pml9w_76eeec1d-c82a-47cf-bf0c-8ee3df21607f/konnectivity-agent/0.log"
May 20 16:23:09.780253 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:09.780229    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-174.ec2.internal_eb002dad605934aeb5aadadf48569211/haproxy/0.log"
May 20 16:23:13.598007 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:13.597977    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nmmrs_77e86c33-86ed-4d41-9962-33db29bb691d/node-exporter/0.log"
May 20 16:23:13.626213 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:13.626189    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nmmrs_77e86c33-86ed-4d41-9962-33db29bb691d/kube-rbac-proxy/0.log"
May 20 16:23:13.649999 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:13.649980    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nmmrs_77e86c33-86ed-4d41-9962-33db29bb691d/init-textfile/0.log"
May 20 16:23:13.993071 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:13.993009    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-qpd4x_b238b507-d1da-439a-a3df-9d745158cd5d/prometheus-operator-admission-webhook/0.log"
May 20 16:23:14.116307 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:14.116283    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78b66885cb-d7z2s_3bb6dcad-638a-4997-bc06-5a358183dd4e/thanos-query/0.log"
May 20 16:23:14.143227 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:14.143204    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78b66885cb-d7z2s_3bb6dcad-638a-4997-bc06-5a358183dd4e/kube-rbac-proxy-web/0.log"
May 20 16:23:14.169086 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:14.169062    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78b66885cb-d7z2s_3bb6dcad-638a-4997-bc06-5a358183dd4e/kube-rbac-proxy/0.log"
May 20 16:23:14.199181 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:14.199157    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78b66885cb-d7z2s_3bb6dcad-638a-4997-bc06-5a358183dd4e/prom-label-proxy/0.log"
May 20 16:23:14.233316 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:14.233294    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78b66885cb-d7z2s_3bb6dcad-638a-4997-bc06-5a358183dd4e/kube-rbac-proxy-rules/0.log"
May 20 16:23:14.268132 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:14.268057    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78b66885cb-d7z2s_3bb6dcad-638a-4997-bc06-5a358183dd4e/kube-rbac-proxy-metrics/0.log"
May 20 16:23:16.250965 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.250938    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-rx45v_a8a14a0c-5ad4-45a9-8e83-a1d659a587de/download-server/0.log"
May 20 16:23:16.417872 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.417843    2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"]
May 20 16:23:16.418158 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.418144    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="327197d7-c7e5-4bf7-a815-b263d14b655f" containerName="splitter-graph-62c44"
May 20 16:23:16.418216 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.418159    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="327197d7-c7e5-4bf7-a815-b263d14b655f" containerName="splitter-graph-62c44"
May 20 16:23:16.418216 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.418172    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a25f8c77-2139-46a5-8076-c5d47ce1a644" containerName="switch-graph-fd7d8"
May 20 16:23:16.418216 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.418177    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="a25f8c77-2139-46a5-8076-c5d47ce1a644" containerName="switch-graph-fd7d8"
May 20 16:23:16.418314 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.418222    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="a25f8c77-2139-46a5-8076-c5d47ce1a644" containerName="switch-graph-fd7d8"
May 20 16:23:16.418314 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.418229    2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="327197d7-c7e5-4bf7-a815-b263d14b655f" containerName="splitter-graph-62c44"
May 20 16:23:16.422409 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.422393    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.424948 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.424930    2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kp2hs\"/\"default-dockercfg-qjmg8\""
May 20 16:23:16.425045 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.424974    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kp2hs\"/\"kube-root-ca.crt\""
May 20 16:23:16.426390 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.426299    2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kp2hs\"/\"openshift-service-ca.crt\""
May 20 16:23:16.429200 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.428808    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"]
May 20 16:23:16.585192 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.585137    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-proc\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.585192 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.585169    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-sys\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.585315 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.585190    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-lib-modules\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.585315 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.585249    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbxxs\" (UniqueName: \"kubernetes.io/projected/fc141221-618a-40eb-9ec3-ab44cf5af459-kube-api-access-dbxxs\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.585315 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.585269    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-podres\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.685775 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.685750    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-proc\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.685890 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.685781    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-sys\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.685890 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.685801    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-lib-modules\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.685890 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.685823    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbxxs\" (UniqueName: \"kubernetes.io/projected/fc141221-618a-40eb-9ec3-ab44cf5af459-kube-api-access-dbxxs\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.685890 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.685849    2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-podres\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.686043 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.685886    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-proc\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.686043 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.685890    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-sys\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.686043 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.685955    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-podres\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.686043 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.685966    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc141221-618a-40eb-9ec3-ab44cf5af459-lib-modules\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.694315 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.694299    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbxxs\" (UniqueName: \"kubernetes.io/projected/fc141221-618a-40eb-9ec3-ab44cf5af459-kube-api-access-dbxxs\") pod \"perf-node-gather-daemonset-t8bs2\" (UID: \"fc141221-618a-40eb-9ec3-ab44cf5af459\") " pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.732703 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.732682    2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:16.855506 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.855482    2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"]
May 20 16:23:16.857821 ip-10-0-135-174 kubenswrapper[2551]: W0520 16:23:16.857795    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc141221_618a_40eb_9ec3_ab44cf5af459.slice/crio-bdcabfd3605d0fd50e78c57fe89cd7cbdec8c12a5e995473fba64d9e5dcd2961 WatchSource:0}: Error finding container bdcabfd3605d0fd50e78c57fe89cd7cbdec8c12a5e995473fba64d9e5dcd2961: Status 404 returned error can't find the container with id bdcabfd3605d0fd50e78c57fe89cd7cbdec8c12a5e995473fba64d9e5dcd2961
May 20 16:23:16.859403 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:16.859390    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 16:23:17.495963 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:17.495935    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xj6h5_8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0/dns/0.log"
May 20 16:23:17.513081 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:17.513053    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2" event={"ID":"fc141221-618a-40eb-9ec3-ab44cf5af459","Type":"ContainerStarted","Data":"897780e37dc9599ad90e652e26900e6d53c5078a5ac4e06a219ea36c4aca5964"}
May 20 16:23:17.513213 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:17.513085    2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2" event={"ID":"fc141221-618a-40eb-9ec3-ab44cf5af459","Type":"ContainerStarted","Data":"bdcabfd3605d0fd50e78c57fe89cd7cbdec8c12a5e995473fba64d9e5dcd2961"}
May 20 16:23:17.513213 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:17.513172    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:17.522409 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:17.522385    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xj6h5_8cb1fdfa-7abf-438d-9ffa-ac0a3906e0d0/kube-rbac-proxy/0.log"
May 20 16:23:17.532625 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:17.532590    2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2" podStartSLOduration=1.532578242 podStartE2EDuration="1.532578242s" podCreationTimestamp="2026-05-20 16:23:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 16:23:17.531431095 +0000 UTC m=+3088.405432835" watchObservedRunningTime="2026-05-20 16:23:17.532578242 +0000 UTC m=+3088.406580023"
May 20 16:23:17.603600 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:17.603580    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wc7k8_cd991773-41b2-4420-9557-6b85bfff5498/dns-node-resolver/0.log"
May 20 16:23:18.049217 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:18.049189    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7t7sn_2ce3d4bd-903a-49be-bb13-86f7c1bad65e/node-ca/0.log"
May 20 16:23:19.229833 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:19.229791    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rz5m6_5d37ad86-bdaa-4e76-901a-c13a1fa6fbe8/serve-healthcheck-canary/0.log"
May 20 16:23:19.662397 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:19.662371    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jm9g_03f6c581-31ad-405b-a11c-5c6f9a77c10a/kube-rbac-proxy/0.log"
May 20 16:23:19.683910 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:19.683887    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jm9g_03f6c581-31ad-405b-a11c-5c6f9a77c10a/exporter/0.log"
May 20 16:23:19.707839 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:19.707816    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jm9g_03f6c581-31ad-405b-a11c-5c6f9a77c10a/extractor/0.log"
May 20 16:23:21.844985 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:21.844960    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-68cc5db7c4-w74vq_a23ab591-6408-483f-9ae1-27ae2440c5d3/manager/0.log"
May 20 16:23:21.869354 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:21.869318    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-86f7b4b499-r9fgg_9851e9c5-6eed-4f92-a46f-8c17945c6d5e/server/0.log"
May 20 16:23:22.103273 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:22.103206    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-696fc77849-t5cf8_070df8d7-baf3-43b2-9ad2-5590351808bf/manager/0.log"
May 20 16:23:23.525706 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:23.525677    2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kp2hs/perf-node-gather-daemonset-t8bs2"
May 20 16:23:27.416703 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:27.416680    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9dh62_5f34274a-efed-4d55-8bda-365b7b66fc6b/kube-multus/0.log"
May 20 16:23:27.460691 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:27.460667    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmslt_d5258eee-17f0-4591-96e6-a83296a06bc4/kube-multus-additional-cni-plugins/0.log"
May 20 16:23:27.487536 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:27.487515    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmslt_d5258eee-17f0-4591-96e6-a83296a06bc4/egress-router-binary-copy/0.log"
May 20 16:23:27.512304 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:27.512269    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmslt_d5258eee-17f0-4591-96e6-a83296a06bc4/cni-plugins/0.log"
May 20 16:23:27.536885 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:27.536868    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmslt_d5258eee-17f0-4591-96e6-a83296a06bc4/bond-cni-plugin/0.log"
May 20 16:23:27.562479 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:27.562459    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmslt_d5258eee-17f0-4591-96e6-a83296a06bc4/routeoverride-cni/0.log"
May 20 16:23:27.589821 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:27.589801    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmslt_d5258eee-17f0-4591-96e6-a83296a06bc4/whereabouts-cni-bincopy/0.log"
May 20 16:23:27.617322 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:27.617301    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmslt_d5258eee-17f0-4591-96e6-a83296a06bc4/whereabouts-cni/0.log"
May 20 16:23:28.100840 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:28.100785    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9mbp7_1788a026-1004-47b0-87a4-192bdb1ecf17/network-metrics-daemon/0.log"
May 20 16:23:28.121210 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:28.121189    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9mbp7_1788a026-1004-47b0-87a4-192bdb1ecf17/kube-rbac-proxy/0.log"
May 20 16:23:29.199516 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:29.199486    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgrgj_2767fe33-7ec4-4e11-8a08-193025168637/ovn-controller/0.log"
May 20 16:23:29.232150 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:29.232125    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgrgj_2767fe33-7ec4-4e11-8a08-193025168637/ovn-acl-logging/0.log"
May 20 16:23:29.263594 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:29.263571    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgrgj_2767fe33-7ec4-4e11-8a08-193025168637/kube-rbac-proxy-node/0.log"
May 20 16:23:29.291368 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:29.291320    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgrgj_2767fe33-7ec4-4e11-8a08-193025168637/kube-rbac-proxy-ovn-metrics/0.log"
May 20 16:23:29.334336 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:29.334315    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgrgj_2767fe33-7ec4-4e11-8a08-193025168637/northd/0.log"
May 20 16:23:29.392793 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:29.392774    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgrgj_2767fe33-7ec4-4e11-8a08-193025168637/nbdb/0.log"
May 20 16:23:29.417274 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:29.417242    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgrgj_2767fe33-7ec4-4e11-8a08-193025168637/sbdb/0.log"
May 20 16:23:29.510583 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:29.510529    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgrgj_2767fe33-7ec4-4e11-8a08-193025168637/ovnkube-controller/0.log"
May 20 16:23:30.832637 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:30.832606    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bwzp6_1437bb6e-5f4b-4872-b432-854c38303dde/network-check-target-container/0.log"
May 20 16:23:31.853625 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:31.853592    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wt7qs_f0f6e707-1c88-43e2-abec-ef705fd106b6/iptables-alerter/0.log"
May 20 16:23:32.484420 ip-10-0-135-174 kubenswrapper[2551]: I0520 16:23:32.484397    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-bmqwk_9e0280da-8fc3-4c71-8b18-856304351935/tuned/0.log"