Jul 30 17:00:23.143843 ip-10-0-137-57 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 17:00:23.588532 ip-10-0-137-57 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 17:00:23.588532 ip-10-0-137-57 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 17:00:23.588532 ip-10-0-137-57 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 17:00:23.588532 ip-10-0-137-57 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 17:00:23.588532 ip-10-0-137-57 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 17:00:23.589640 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.589528    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 17:00:23.593487 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593472    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:23.593487 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593487    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593490    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593493    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593496    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593499    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593502    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593504    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593507    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593509    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593512    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593515    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593518    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593520    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593523    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593530    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593533    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593536    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593538    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593541    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:23.593566 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593544    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593558    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593561    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593564    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593567    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593569    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593572    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593575    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593577    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593580    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593583    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593585    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593588    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593590    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593592    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593595    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593597    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593600    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593602    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593605    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:23.594014 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593607    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593609    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593612    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593614    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593616    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593619    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593621    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593625    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593627    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593630    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593632    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593634    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593638    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593642    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593645    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593648    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593652    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593655    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593658    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:23.594488 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593660    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593663    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593666    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593668    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593671    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593674    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593677    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593680    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593682    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593685    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593687    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593690    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593692    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593695    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593697    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593700    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593702    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593705    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593707    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:23.594996 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593710    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593712    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593717    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593719    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593723    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593725    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593728    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593730    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593733    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593735    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593738    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593740    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593743    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593745    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593747    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593750    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593752    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593755    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593757    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593759    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:23.595462 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.593762    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594423    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594430    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594434    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594437    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594440    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594443    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594446    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594449    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594452    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594455    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594457    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594460    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594463    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594465    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594468    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594471    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594473    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594476    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594478    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:23.595965 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594480    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594483    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594485    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594488    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594490    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594493    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594497    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594501    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594504    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594507    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594510    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594512    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594514    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594517    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594519    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594521    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594524    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594526    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594528    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594531    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:23.596456 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594534    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594536    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594539    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594541    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594543    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594562    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594566    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594568    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594571    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594574    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594576    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594579    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594581    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594584    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594588    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594592    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594594    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594597    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594599    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:23.596958 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594602    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594604    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594607    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594609    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594612    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594614    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594616    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594619    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594621    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594626    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594629    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594632    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594634    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594637    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594640    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594642    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594644    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594647    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594650    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594652    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:23.597410 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594655    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594657    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594660    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594663    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594665    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594668    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594670    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594673    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594675    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594678    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594680    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594683    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594685    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594688    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594690    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594692    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594695    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594697    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594700    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594702    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:23.597984 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.594706    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595053    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595058    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595061    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595064    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595067    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595070    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595073    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595075    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595078    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595081    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595083    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595086    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595089    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595091    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595094    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595096    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595099    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595101    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595103    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595106    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:23.598470 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595108    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595111    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595114    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595118    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595120    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595123    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595126    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595128    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595132    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595136    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595138    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595141    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595146    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595150    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595153    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595155    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595158    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595162    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595165    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:23.598979 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595167    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595170    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595173    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595176    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595178    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595181    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595183    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595186    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595188    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595190    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595193    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595195    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595198    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595200    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595202    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595205    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595207    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595210    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595212    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595214    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:23.599437 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595217    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595219    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595221    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595224    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595227    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595231    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595233    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595236    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595238    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595240    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595243    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595246    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595248    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595251    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595254    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595256    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595259    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595261    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595263    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:23.599967 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595266    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595269    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595271    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595273    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595276    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595278    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595281    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595283    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595286    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595288    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595291    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595293    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595296    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595298    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595300    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595303    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595305    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595307    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595312    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595315    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:23.600418 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595318    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595382    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595388    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595394    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595398    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595402    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595405    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595409    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595413    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595416    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595419    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595422    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595425    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595428    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595430    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595433    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595436    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595438    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595441    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595444    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595447    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595450    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595453    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595456    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 17:00:23.600918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595459    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595462    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595465    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595468    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595471    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595474    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595478    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595481    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595485    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595489    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595492    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595494    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595497    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595500    2561 flags.go:64] FLAG: --enable-server="true"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595503    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595507    2561 flags.go:64] FLAG: --event-burst="100"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595510    2561 flags.go:64] FLAG: --event-qps="50"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595512    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595515    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595518    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595521    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595523    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595526    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595529    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595532    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 17:00:23.601486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595534    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595537    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595540    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595542    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595560    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595564    2561 flags.go:64] FLAG: --feature-gates=""
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595567    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595570    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595573    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595576    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595579    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595581    2561 flags.go:64] FLAG: --help="false"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595584    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-137-57.ec2.internal"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595588    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595591    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595595    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595598    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595601    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595604    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595606    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595609    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595612    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595615    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595618    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 17:00:23.602112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595621    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595624    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595626    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595629    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595632    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595635    2561 flags.go:64] FLAG: --lock-file=""
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595637    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595640    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595643    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595648    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595651    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595653    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595656    2561 flags.go:64] FLAG: --logging-format="text"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595659    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595662    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595664    2561 flags.go:64] FLAG: --manifest-url=""
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595667    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595671    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595674    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595677    2561 flags.go:64] FLAG: --max-pods="110"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595680    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595684    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595686    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595690    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595693    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 17:00:23.602715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595696    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595699    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595705    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595708    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595711    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595714    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595717    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595722    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595725    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595728    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595730    2561 flags.go:64] FLAG: --port="10250"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595733    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595736    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cc6cf6dd1c678bc0"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595739    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595742    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595745    2561 flags.go:64] FLAG: --register-node="true"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595747    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595750    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595753    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595756    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595758    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595761    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595764    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595767    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595770    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 17:00:23.603364 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595772    2561 flags.go:64] FLAG: --runonce="false"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595775    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595778    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595780    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595784    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595788    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595791    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595794    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595797    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595799    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595802    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595804    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595807    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595810    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595813    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595816    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595820    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595823    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595826    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595829    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595832    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595835    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595837    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595840    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595843    2561 flags.go:64] FLAG: --v="2"
Jul 30 17:00:23.603978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595846    2561 flags.go:64] FLAG: --version="false"
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595850    2561 flags.go:64] FLAG: --vmodule=""
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595853    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.595856    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595964    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595969    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595972    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595974    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595977    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595980    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595983    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595986    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595989    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595992    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595994    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595996    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.595999    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596001    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596004    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596006    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:23.604577 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596008    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596011    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596014    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596016    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596018    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596021    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596023    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596026    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596028    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596030    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596033    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596035    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596038    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596040    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596042    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596045    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596047    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596050    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596052    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:23.605064 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596054    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596057    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596059    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596061    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596064    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596069    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596071    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596073    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596076    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596078    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596081    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596083    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596086    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596088    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596090    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596093    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596097    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596101    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596104    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:23.605510 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596107    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596109    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596112    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596114    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596117    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596120    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596122    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596126    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596129    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596132    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596135    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596137    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596139    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596142    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596144    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596147    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596149    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596152    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596155    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596158    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:23.605991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596160    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596163    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596165    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596168    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596170    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596173    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596175    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596178    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596180    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596183    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596185    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596188    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596191    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596195    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596197    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596200    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596202    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596204    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596207    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596209    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:23.606603 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596211    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:23.607078 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596214    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:23.607078 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596216    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:23.607078 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596218    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:23.607078 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.596221    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:23.607078 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.596226    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 17:00:23.609529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.609507    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 17:00:23.609529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.609527    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 17:00:23.609645 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.609563    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 17:00:23.609645 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.609570    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 17:00:23.609645 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609631    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:23.609645 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609636    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:23.609645 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609640    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:23.609645 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609643    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:23.609645 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609646    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:23.609645 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609649    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609651    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609654    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609656    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609659    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609661    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609664    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609666    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609669    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609671    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609674    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609676    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609679    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609681    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609684    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609686    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609688    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609691    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609693    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:23.609839 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609696    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609698    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609700    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609703    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609705    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609713    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609716    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609718    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609722    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609725    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609728    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609731    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609734    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609736    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609739    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609742    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609745    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609748    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609758    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:23.610298 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609760    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609763    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609766    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609768    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609771    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609774    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609776    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609779    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609781    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609783    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609786    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609788    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609792    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609796    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609798    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609801    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609803    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609806    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609808    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609816    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:23.610895 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609818    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609821    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609823    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609826    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609828    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609830    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609833    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609835    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609838    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609841    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609843    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609846    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609849    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609851    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609854    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609856    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609859    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609861    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609863    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609866    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:23.611731 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609868    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609870    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609873    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609875    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609877    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609880    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609882    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609885    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609887    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609889    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609892    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609895    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609904    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609907    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609909    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:23.612222 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.609912    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.609917    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610061    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610065    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610068    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610071    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610074    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610077    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610080    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610084    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610086    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610089    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610091    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610093    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:00:23.612602 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610096    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610098    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610101    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610103    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610105    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610108    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610110    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610112    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610115    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610118    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610121    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610123    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610126    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610128    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610130    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610133    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610140    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610143    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610145    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610147    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:00:23.612954 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610150    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610152    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610155    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610158    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610160    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610163    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610165    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610167    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610170    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610172    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610174    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610176    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610179    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610181    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610183    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610186    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610188    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610191    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610193    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610195    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:00:23.613444 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610198    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610200    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610202    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610205    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610208    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610210    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610212    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610216    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610219    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610227    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610230    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610233    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610235    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610238    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610241    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610244    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610247    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610250    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610252    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:00:23.613991 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610254    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610256    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610259    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610261    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610264    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610266    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610268    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610270    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610273    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610275    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610277    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610279    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610282    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610284    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610286    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610288    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610291    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610293    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610296    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610298    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:00:23.614448 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610300    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:00:23.614963 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610303    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:00:23.614963 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610305    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:00:23.614963 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610313    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:00:23.614963 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610316    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:00:23.614963 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610318    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:00:23.614963 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610320    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:00:23.614963 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:23.610323    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:00:23.614963 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.610327    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 17:00:23.614963 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.610414    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 17:00:23.614963 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.613427    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 17:00:23.615216 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.615190    2561 server.go:1019] "Starting client certificate rotation"
Jul 30 17:00:23.615301 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.615283    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 17:00:23.615333 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.615323    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 17:00:23.617952 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.617940    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 17:00:23.618983 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.618965    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 17:00:23.638894 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.638875    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 30 17:00:23.641322 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.641310    2561 log.go:25] "Validated CRI v1 image API"
Jul 30 17:00:23.642156 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.642138    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 17:00:23.647506 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.647488    2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b7d71cf1-c822-4a70-9fe4-de15d040a636:/dev/nvme0n1p4 fa265b27-b8f0-46c3-bf76-86428e3b4016:/dev/nvme0n1p3]
Jul 30 17:00:23.647589 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.647505    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 17:00:23.648157 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.648138    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 17:00:23.653507 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.653408    2561 manager.go:216] Machine: {Timestamp:2026-07-30 17:00:23.65211775 +0000 UTC m=+0.381730259 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098131 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e0668b17ff90d4b2d74c902d2f69 SystemUUID:ec25e066-8b17-ff90-d4b2-d74c902d2f69 BootID:8547050b-8b30-4683-b8db-040af704b9f8 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:86:ef:de:9c:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:86:ef:de:9c:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:66:44:06:be:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 17:00:23.653507 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.653504    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 17:00:23.653642 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.653582    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 17:00:23.656983 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.656962    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 17:00:23.657483 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.656986    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 17:00:23.658268 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.658240    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 17:00:23.658366 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.658274    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 17:00:23.658366 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.658286    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 17:00:23.659268 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.659245    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 17:00:23.661332 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.661318    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 17:00:23.665950 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.665938    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 17:00:23.666047 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.666038    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 17:00:23.666098 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.666067    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 17:00:23.666098 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.666076    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 17:00:23.666098 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.666089    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 17:00:23.666098 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.666097    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 30 17:00:23.666260 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.666106    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 17:00:23.666434 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.666423    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 17:00:23.666463 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.666440    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 17:00:23.668853 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.668836    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 17:00:23.670657 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.670643    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 17:00:23.670719 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.670672    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 17:00:23.671432 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671415    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 17:00:23.671509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671445    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 17:00:23.671509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671451    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 17:00:23.671509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671456    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 17:00:23.671509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671464    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 17:00:23.671509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671470    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 17:00:23.671509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671488    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 17:00:23.671509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671494    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 17:00:23.671509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671500    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 17:00:23.671509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671505    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 17:00:23.671509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671514    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 17:00:23.671786 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.671521    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 17:00:23.672437 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.672427    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 17:00:23.672437 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.672437    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 17:00:23.675469 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.675455    2561 server.go:1268] "Started kubelet"
Jul 30 17:00:23.675600 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.675541    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 17:00:23.675675 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.675597    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 17:00:23.675725 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.675704    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 17:00:23.676145 ip-10-0-137-57 systemd[1]: Started Kubernetes Kubelet.
Jul 30 17:00:23.677900 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.677830    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 17:00:23.677972 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.677864    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 17:00:23.677972 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.677866    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 17:00:23.677972 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.677932    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 17:00:23.678386 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.678374    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 17:00:23.682451 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.682433    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 17:00:23.682654 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.681512    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-57.ec2.internal.18c71fdfe035020c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-57.ec2.internal,UID:ip-10-0-137-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-57.ec2.internal,},FirstTimestamp:2026-07-30 17:00:23.675429388 +0000 UTC m=+0.405041876,LastTimestamp:2026-07-30 17:00:23.675429388 +0000 UTC m=+0.405041876,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-57.ec2.internal,}"
Jul 30 17:00:23.687807 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.687789    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 17:00:23.687898 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.687806    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 17:00:23.687898 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.687892    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:23.688584 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.688567    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 17:00:23.688584 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.688587    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 17:00:23.688733 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.688593    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 17:00:23.688733 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.688667    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 17:00:23.688733 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.688675    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 17:00:23.688887 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.688873    2561 factory.go:55] Registering systemd factory
Jul 30 17:00:23.688941 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.688892    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 30 17:00:23.689120 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.689091    2561 factory.go:153] Registering CRI-O factory
Jul 30 17:00:23.689120 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.689107    2561 factory.go:223] Registration of the crio container factory successfully
Jul 30 17:00:23.689234 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.689154    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 17:00:23.689234 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.689176    2561 factory.go:103] Registering Raw factory
Jul 30 17:00:23.689234 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.689193    2561 manager.go:1196] Started watching for new ooms in manager
Jul 30 17:00:23.690596 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.690543    2561 manager.go:349] Starting recovery of all containers
Jul 30 17:00:23.692395 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.692366    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 17:00:23.692500 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.692477    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 17:00:23.694275 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.694240    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jcx46"
Jul 30 17:00:23.701312 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.701217    2561 manager.go:354] Recovery completed
Jul 30 17:00:23.702606 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.702587    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jcx46"
Jul 30 17:00:23.705223 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.705211    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:23.708051 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.708037    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:23.708111 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.708064    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:23.708111 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.708077    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:23.708535 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.708524    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 17:00:23.708535 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.708533    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 17:00:23.708682 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.708540    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:23.708682 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.708566    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 17:00:23.709217 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.709200    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:23.709292 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.709232    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:23.709292 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.709246    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:23.710188 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.710121    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-57.ec2.internal.18c71fdfe226c23c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-57.ec2.internal,UID:ip-10-0-137-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-57.ec2.internal,},FirstTimestamp:2026-07-30 17:00:23.70804998 +0000 UTC m=+0.437662472,LastTimestamp:2026-07-30 17:00:23.70804998 +0000 UTC m=+0.437662472,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-57.ec2.internal,}"
Jul 30 17:00:23.710623 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.710605    2561 policy_none.go:49] "None policy: Start"
Jul 30 17:00:23.710623 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.710625    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 17:00:23.710722 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.710636    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 17:00:23.712507 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.712496    2561 policy_none.go:47] "Start"
Jul 30 17:00:23.749212 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.749197    2561 manager.go:337] "Starting Device Plugin manager"
Jul 30 17:00:23.773634 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.749243    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 17:00:23.773634 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.749256    2561 server.go:87] "Starting device plugin registration server"
Jul 30 17:00:23.773634 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.749442    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 17:00:23.773634 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.749453    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 17:00:23.773634 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.749538    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 17:00:23.773634 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.749628    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 17:00:23.773634 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.749637    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 17:00:23.773634 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.750150    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 17:00:23.773634 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.750201    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:23.793579 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.793527    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 17:00:23.794748 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.794734    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 17:00:23.794818 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.794769    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 17:00:23.794818 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.794787    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 17:00:23.794899 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.794817    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 17:00:23.796927 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.796913    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:00:23.849819 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.849772    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:23.850490 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.850475    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:23.850602 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.850500    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:23.850602 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.850510    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:23.850602 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.850529    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-57.ec2.internal"
Jul 30 17:00:23.858700 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.858687    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-57.ec2.internal"
Jul 30 17:00:23.858752 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.858705    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-57.ec2.internal\": node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:23.880401 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.880374    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:23.895866 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.895846    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"]
Jul 30 17:00:23.895921 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.895898    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:23.897290 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.897267    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:23.897290 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.897292    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:23.897389 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.897301    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:23.899438 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.899427    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:23.899571 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.899542    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:23.899611 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.899584    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:23.900156 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.900142    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:23.900230 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.900171    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:23.900230 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.900181    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:23.900230 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.900147    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:23.900342 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.900237    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:23.900342 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.900252    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:23.902830 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.902815    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:23.902901 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.902839    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:00:23.903460 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.903436    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:00:23.903511 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.903465    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:00:23.903511 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.903478    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:00:23.935132 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.935111    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-57.ec2.internal\" not found" node="ip-10-0-137-57.ec2.internal"
Jul 30 17:00:23.939141 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.939126    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-57.ec2.internal\" not found" node="ip-10-0-137-57.ec2.internal"
Jul 30 17:00:23.980559 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:23.980537    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:23.990897 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.990881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8fd3bb6c30f22271f3ed6f5503e00a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"f8fd3bb6c30f22271f3ed6f5503e00a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:23.990946 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.990910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8fd3bb6c30f22271f3ed6f5503e00a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"f8fd3bb6c30f22271f3ed6f5503e00a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:23.990946 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:23.990926    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2d5e43724ffee48daaf282f2e083298-config\") pod \"kube-apiserver-proxy-ip-10-0-137-57.ec2.internal\" (UID: \"e2d5e43724ffee48daaf282f2e083298\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:24.081433 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:24.081414    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:24.091782 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.091766    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8fd3bb6c30f22271f3ed6f5503e00a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"f8fd3bb6c30f22271f3ed6f5503e00a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:24.091834 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.091789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2d5e43724ffee48daaf282f2e083298-config\") pod \"kube-apiserver-proxy-ip-10-0-137-57.ec2.internal\" (UID: \"e2d5e43724ffee48daaf282f2e083298\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:24.091834 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.091807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8fd3bb6c30f22271f3ed6f5503e00a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"f8fd3bb6c30f22271f3ed6f5503e00a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:24.091894 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.091850    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8fd3bb6c30f22271f3ed6f5503e00a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"f8fd3bb6c30f22271f3ed6f5503e00a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:24.091894 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.091850    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2d5e43724ffee48daaf282f2e083298-config\") pod \"kube-apiserver-proxy-ip-10-0-137-57.ec2.internal\" (UID: \"e2d5e43724ffee48daaf282f2e083298\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:24.091894 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.091883    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f8fd3bb6c30f22271f3ed6f5503e00a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal\" (UID: \"f8fd3bb6c30f22271f3ed6f5503e00a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:24.182216 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:24.182164    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:24.237666 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.237646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:24.243814 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.243421    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:24.282648 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:24.282625    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:24.383154 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:24.383130    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:24.483715 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:24.483668    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:24.584131 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:24.584113    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:24.614646 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.614630    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 17:00:24.615019 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.614736    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 17:00:24.684457 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:24.684438    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:24.692704 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.692684    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:00:24.708730 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.708700    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 16:55:24 +0000 UTC" deadline="2028-04-29 14:31:22.737766908 +0000 UTC"
Jul 30 17:00:24.708730 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:24.708725    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15333h30m58.029044451s"
Jul 30 17:00:24.785061 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:24.785008    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:24.885129 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:24.885112    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:24.985694 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:24.985670    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-57.ec2.internal\" not found"
Jul 30 17:00:25.004010 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.003992    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:00:25.088394 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.088345    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:25.101487 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.101471    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 17:00:25.102358 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.102338    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal"
Jul 30 17:00:25.109161 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.109143    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 17:00:25.213613 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.213592    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:00:25.230974 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:25.230939    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d5e43724ffee48daaf282f2e083298.slice/crio-37bc919ea23b8aae5d72f3dec39c30933de72866169aa9bc5df5dca9408616e5 WatchSource:0}: Error finding container 37bc919ea23b8aae5d72f3dec39c30933de72866169aa9bc5df5dca9408616e5: Status 404 returned error can't find the container with id 37bc919ea23b8aae5d72f3dec39c30933de72866169aa9bc5df5dca9408616e5
Jul 30 17:00:25.231214 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:25.231195    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8fd3bb6c30f22271f3ed6f5503e00a6.slice/crio-4717cd48c4c1002cd7806ee5aeb08d60e0d056b8bb3eea9c927cc03a028d1a43 WatchSource:0}: Error finding container 4717cd48c4c1002cd7806ee5aeb08d60e0d056b8bb3eea9c927cc03a028d1a43: Status 404 returned error can't find the container with id 4717cd48c4c1002cd7806ee5aeb08d60e0d056b8bb3eea9c927cc03a028d1a43
Jul 30 17:00:25.235511 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.235496    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 17:00:25.656691 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.656671    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:00:25.667705 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.667689    2561 apiserver.go:52] "Watching apiserver"
Jul 30 17:00:25.676632 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.676597    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 17:00:25.677075 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.677049    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-59w8z","openshift-ovn-kubernetes/ovnkube-node-tf9jb","kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7","openshift-dns/node-resolver-w95np","openshift-image-registry/node-ca-98hsx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal","openshift-multus/multus-additional-cni-plugins-7rt6d","openshift-network-operator/iptables-alerter-z5w75","kube-system/global-pull-secret-syncer-zsm4g","kube-system/konnectivity-agent-zpbkp","openshift-cluster-node-tuning-operator/tuned-6ncrg","openshift-multus/multus-d4rpt","openshift-multus/network-metrics-daemon-8h2br"]
Jul 30 17:00:25.679794 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.679772    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z5w75"
Jul 30 17:00:25.682308 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.682285    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.682420 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.682399    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n9xfn\""
Jul 30 17:00:25.682908 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.682887    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:00:25.683013 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.682942    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 17:00:25.683013 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.682886    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 17:00:25.685137 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.684852    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:25.685137 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:25.684928    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:25.685315 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.685299    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 17:00:25.685774 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.685753    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 17:00:25.686601 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.686534    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 17:00:25.686601 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.686565    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 17:00:25.687523 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.686941    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 17:00:25.687523 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.686989    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c84tb\""
Jul 30 17:00:25.687523 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.687140    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 17:00:25.687523 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.687463    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.688901 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.688272    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 17:00:25.690810 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.690298    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 17:00:25.690810 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.690382    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 17:00:25.690810 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.690554    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 17:00:25.690810 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.690304    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8gn2h\""
Jul 30 17:00:25.691073 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.690953    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w95np"
Jul 30 17:00:25.693260 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.693239    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 17:00:25.693357 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.693335    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ssts6\""
Jul 30 17:00:25.693463 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.693447    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 17:00:25.694974 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.694508    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.696817 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.696798    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 17:00:25.696933 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.696908    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 17:00:25.697035 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.697002    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:25.697109 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.697058    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xzszr\""
Jul 30 17:00:25.697199 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.697179    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 17:00:25.697309 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.697284    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 17:00:25.698323 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-run-ovn-kubernetes\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698434 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-sys-fs\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.698434 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-run-ovn\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698434 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698410    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-kubelet\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698605 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-run-netns\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698605 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698474    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698605 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-slash\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698605 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0114f8e3-aa50-42e7-94f1-b0394d76da17-ovn-node-metrics-cert\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698605 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698562    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:25.698605 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.698953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-cni-bin\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698669    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-cni-netd\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698710    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dccf377-bcac-4887-92eb-672c457457ad-tmp-dir\") pod \"node-resolver-w95np\" (UID: \"0dccf377-bcac-4887-92eb-672c457457ad\") " pod="openshift-dns/node-resolver-w95np"
Jul 30 17:00:25.698953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twwn7\" (UniqueName: \"kubernetes.io/projected/1dbb4c7d-0db6-445e-8460-82ba99d62c2b-kube-api-access-twwn7\") pod \"iptables-alerter-z5w75\" (UID: \"1dbb4c7d-0db6-445e-8460-82ba99d62c2b\") " pod="openshift-network-operator/iptables-alerter-z5w75"
Jul 30 17:00:25.698953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0114f8e3-aa50-42e7-94f1-b0394d76da17-ovnkube-script-lib\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698812    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4njv\" (UniqueName: \"kubernetes.io/projected/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-kube-api-access-r4njv\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:25.698953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1dbb4c7d-0db6-445e-8460-82ba99d62c2b-iptables-alerter-script\") pod \"iptables-alerter-z5w75\" (UID: \"1dbb4c7d-0db6-445e-8460-82ba99d62c2b\") " pod="openshift-network-operator/iptables-alerter-z5w75"
Jul 30 17:00:25.698953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-log-socket\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-systemd-units\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-run-systemd\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.698953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-etc-openvswitch\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698965    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-run-openvswitch\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.698981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0114f8e3-aa50-42e7-94f1-b0394d76da17-env-overrides\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67546\" (UniqueName: \"kubernetes.io/projected/0114f8e3-aa50-42e7-94f1-b0394d76da17-kube-api-access-67546\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-var-lib-openvswitch\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxpd5\" (UniqueName: \"kubernetes.io/projected/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-kube-api-access-sxpd5\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0dccf377-bcac-4887-92eb-672c457457ad-hosts-file\") pod \"node-resolver-w95np\" (UID: \"0dccf377-bcac-4887-92eb-672c457457ad\") " pod="openshift-dns/node-resolver-w95np"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699158    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4rkh\" (UniqueName: \"kubernetes.io/projected/0dccf377-bcac-4887-92eb-672c457457ad-kube-api-access-p4rkh\") pod \"node-resolver-w95np\" (UID: \"0dccf377-bcac-4887-92eb-672c457457ad\") " pod="openshift-dns/node-resolver-w95np"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1dbb4c7d-0db6-445e-8460-82ba99d62c2b-host-slash\") pod \"iptables-alerter-z5w75\" (UID: \"1dbb4c7d-0db6-445e-8460-82ba99d62c2b\") " pod="openshift-network-operator/iptables-alerter-z5w75"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699199    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-node-log\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699239    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0114f8e3-aa50-42e7-94f1-b0394d76da17-ovnkube-config\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699270    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-socket-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699302    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-registration-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-device-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699367    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z245f\""
Jul 30 17:00:25.699501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.699428    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 17:00:25.700391 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.700322    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 17:00:25.701654 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.701634    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.704707 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.704361    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:25.704707 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:25.704433    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:25.704849 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.704723    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5k4qx\""
Jul 30 17:00:25.704849 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.704779    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 17:00:25.704942 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.704733    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 17:00:25.707451 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.707055    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:25.707451 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:25.707127    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:25.709725 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.709703    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.712074 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.711866    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:00:25.712074 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.711878    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zb8dj\""
Jul 30 17:00:25.712199 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.712075    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 17:00:25.713222 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.713189    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-98hsx"
Jul 30 17:00:25.715621 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.715605    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 17:00:25.715731 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.715625    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 17:00:25.715879 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.715861    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 17:00:25.715965 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.715885    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zc9v7\""
Jul 30 17:00:25.732419 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.732396    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vszh"
Jul 30 17:00:25.743970 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.743948    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5vszh"
Jul 30 17:00:25.792956 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.792926    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799588    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-slash\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799618    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799647    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41d50b58-6804-479b-a731-a2e3e4d3b2cd-host\") pod \"node-ca-98hsx\" (UID: \"41d50b58-6804-479b-a731-a2e3e4d3b2cd\") " pod="openshift-image-registry/node-ca-98hsx"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ed19618-5096-494b-b51f-d80f84f2b7a9-kubelet-config\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-run\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799743    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-daemon-config\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799761    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-cni-bin\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dccf377-bcac-4887-92eb-672c457457ad-tmp-dir\") pod \"node-resolver-w95np\" (UID: \"0dccf377-bcac-4887-92eb-672c457457ad\") " pod="openshift-dns/node-resolver-w95np"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799797    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0114f8e3-aa50-42e7-94f1-b0394d76da17-ovnkube-script-lib\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1dbb4c7d-0db6-445e-8460-82ba99d62c2b-iptables-alerter-script\") pod \"iptables-alerter-z5w75\" (UID: \"1dbb4c7d-0db6-445e-8460-82ba99d62c2b\") " pod="openshift-network-operator/iptables-alerter-z5w75"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799832    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-sysctl-d\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-cni-binary-copy\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.802136 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-conf-dir\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-systemd-units\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-run-openvswitch\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.799996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0114f8e3-aa50-42e7-94f1-b0394d76da17-env-overrides\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67546\" (UniqueName: \"kubernetes.io/projected/0114f8e3-aa50-42e7-94f1-b0394d76da17-kube-api-access-67546\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800049    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-system-cni-dir\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800075    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-var-lib-kubelet\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-etc-kubernetes\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxpd5\" (UniqueName: \"kubernetes.io/projected/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-kube-api-access-sxpd5\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0dccf377-bcac-4887-92eb-672c457457ad-hosts-file\") pod \"node-resolver-w95np\" (UID: \"0dccf377-bcac-4887-92eb-672c457457ad\") " pod="openshift-dns/node-resolver-w95np"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800221    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-cni-binary-copy\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800246    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpmsw\" (UniqueName: \"kubernetes.io/projected/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-kube-api-access-xpmsw\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-node-log\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-device-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-sysconfig\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800360    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-kubernetes\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.803061 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800386    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-run-netns\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-run-multus-certs\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qt7g\" (UniqueName: \"kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g\") pod \"network-check-target-59w8z\" (UID: \"b2e74fdd-1e27-4058-9fd2-c45fa2071573\") " pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800465    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-sys-fs\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800503    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-run-k8s-cni-cncf-io\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-var-lib-cni-bin\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800565    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-var-lib-cni-multus\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-run-ovn\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-kubelet\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-run-netns\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800703    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e8be5d1-1706-4b21-90b8-2e502085e034-konnectivity-ca\") pod \"konnectivity-agent-zpbkp\" (UID: \"3e8be5d1-1706-4b21-90b8-2e502085e034\") " pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0114f8e3-aa50-42e7-94f1-b0394d76da17-ovn-node-metrics-cert\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800753    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-os-release\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-var-lib-kubelet\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.803973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-system-cni-dir\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-cni-netd\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twwn7\" (UniqueName: \"kubernetes.io/projected/1dbb4c7d-0db6-445e-8460-82ba99d62c2b-kube-api-access-twwn7\") pod \"iptables-alerter-z5w75\" (UID: \"1dbb4c7d-0db6-445e-8460-82ba99d62c2b\") " pod="openshift-network-operator/iptables-alerter-z5w75"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800918    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41d50b58-6804-479b-a731-a2e3e4d3b2cd-serviceca\") pod \"node-ca-98hsx\" (UID: \"41d50b58-6804-479b-a731-a2e3e4d3b2cd\") " pod="openshift-image-registry/node-ca-98hsx"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800944    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-sys\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800966    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77466359-549d-44f7-bfd1-feae2b80d29c-etc-tuned\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.800989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-hostroot\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4njv\" (UniqueName: \"kubernetes.io/projected/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-kube-api-access-r4njv\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801049    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-cnibin\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801077    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-systemd\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-lib-modules\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801127    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dccf377-bcac-4887-92eb-672c457457ad-tmp-dir\") pod \"node-resolver-w95np\" (UID: \"0dccf377-bcac-4887-92eb-672c457457ad\") " pod="openshift-dns/node-resolver-w95np"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-os-release\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801316    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-run-ovn\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801332    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801378    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0dccf377-bcac-4887-92eb-672c457457ad-hosts-file\") pod \"node-resolver-w95np\" (UID: \"0dccf377-bcac-4887-92eb-672c457457ad\") " pod="openshift-dns/node-resolver-w95np"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801385    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-run-netns\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.804728 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801403    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-slash\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0114f8e3-aa50-42e7-94f1-b0394d76da17-ovnkube-script-lib\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:25.801505    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:25.801551    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs podName:6e3bd573-f6fa-4ab5-8aff-d0c113a700ac nodeName:}" failed. No retries permitted until 2026-07-30 17:00:26.301537014 +0000 UTC m=+3.031149492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs") pod "network-metrics-daemon-8h2br" (UID: "6e3bd573-f6fa-4ab5-8aff-d0c113a700ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801744    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-node-log\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801797    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-device-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-cni-bin\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-log-socket\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801920    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801950    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-sys-fs\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.801993    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-log-socket\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-run-systemd\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-etc-openvswitch\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802071    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1dbb4c7d-0db6-445e-8460-82ba99d62c2b-iptables-alerter-script\") pod \"iptables-alerter-z5w75\" (UID: \"1dbb4c7d-0db6-445e-8460-82ba99d62c2b\") " pod="openshift-network-operator/iptables-alerter-z5w75"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802092    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1dbb4c7d-0db6-445e-8460-82ba99d62c2b-host-slash\") pod \"iptables-alerter-z5w75\" (UID: \"1dbb4c7d-0db6-445e-8460-82ba99d62c2b\") " pod="openshift-network-operator/iptables-alerter-z5w75"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e8be5d1-1706-4b21-90b8-2e502085e034-agent-certs\") pod \"konnectivity-agent-zpbkp\" (UID: \"3e8be5d1-1706-4b21-90b8-2e502085e034\") " pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:25.805474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-systemd-units\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-var-lib-openvswitch\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802198    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4rkh\" (UniqueName: \"kubernetes.io/projected/0dccf377-bcac-4887-92eb-672c457457ad-kube-api-access-p4rkh\") pod \"node-resolver-w95np\" (UID: \"0dccf377-bcac-4887-92eb-672c457457ad\") " pod="openshift-dns/node-resolver-w95np"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-run-openvswitch\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-run-systemd\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802399    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-sysctl-conf\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802428    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-host\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-cni-dir\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-socket-dir-parent\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802519    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0114f8e3-aa50-42e7-94f1-b0394d76da17-ovnkube-config\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-socket-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-registration-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802614    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llltq\" (UniqueName: \"kubernetes.io/projected/41d50b58-6804-479b-a731-a2e3e4d3b2cd-kube-api-access-llltq\") pod \"node-ca-98hsx\" (UID: \"41d50b58-6804-479b-a731-a2e3e4d3b2cd\") " pod="openshift-image-registry/node-ca-98hsx"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802647    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0114f8e3-aa50-42e7-94f1-b0394d76da17-env-overrides\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802752    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58ghc\" (UniqueName: \"kubernetes.io/projected/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-kube-api-access-58ghc\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802756    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-cni-netd\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.802939    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1dbb4c7d-0db6-445e-8460-82ba99d62c2b-host-slash\") pod \"iptables-alerter-z5w75\" (UID: \"1dbb4c7d-0db6-445e-8460-82ba99d62c2b\") " pod="openshift-network-operator/iptables-alerter-z5w75"
Jul 30 17:00:25.806171 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ed19618-5096-494b-b51f-d80f84f2b7a9-dbus\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-run-ovn-kubernetes\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803084    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-modprobe-d\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77466359-549d-44f7-bfd1-feae2b80d29c-tmp\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf4n8\" (UniqueName: \"kubernetes.io/projected/77466359-549d-44f7-bfd1-feae2b80d29c-kube-api-access-wf4n8\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-cnibin\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-run-ovn-kubernetes\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803458    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0114f8e3-aa50-42e7-94f1-b0394d76da17-ovnkube-config\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803456    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal" event={"ID":"e2d5e43724ffee48daaf282f2e083298","Type":"ContainerStarted","Data":"37bc919ea23b8aae5d72f3dec39c30933de72866169aa9bc5df5dca9408616e5"}
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-etc-openvswitch\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-var-lib-openvswitch\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803578    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803616    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-registration-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-socket-dir\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.806934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.803908    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0114f8e3-aa50-42e7-94f1-b0394d76da17-host-kubelet\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.808189 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.808169    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0114f8e3-aa50-42e7-94f1-b0394d76da17-ovn-node-metrics-cert\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.808349 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.808328    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal" event={"ID":"f8fd3bb6c30f22271f3ed6f5503e00a6","Type":"ContainerStarted","Data":"4717cd48c4c1002cd7806ee5aeb08d60e0d056b8bb3eea9c927cc03a028d1a43"}
Jul 30 17:00:25.811935 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.811914    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67546\" (UniqueName: \"kubernetes.io/projected/0114f8e3-aa50-42e7-94f1-b0394d76da17-kube-api-access-67546\") pod \"ovnkube-node-tf9jb\" (UID: \"0114f8e3-aa50-42e7-94f1-b0394d76da17\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:25.814980 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.814956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxpd5\" (UniqueName: \"kubernetes.io/projected/c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6-kube-api-access-sxpd5\") pod \"aws-ebs-csi-driver-node-vdcq7\" (UID: \"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:25.815198 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.815178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4rkh\" (UniqueName: \"kubernetes.io/projected/0dccf377-bcac-4887-92eb-672c457457ad-kube-api-access-p4rkh\") pod \"node-resolver-w95np\" (UID: \"0dccf377-bcac-4887-92eb-672c457457ad\") " pod="openshift-dns/node-resolver-w95np"
Jul 30 17:00:25.815640 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.815613    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twwn7\" (UniqueName: \"kubernetes.io/projected/1dbb4c7d-0db6-445e-8460-82ba99d62c2b-kube-api-access-twwn7\") pod \"iptables-alerter-z5w75\" (UID: \"1dbb4c7d-0db6-445e-8460-82ba99d62c2b\") " pod="openshift-network-operator/iptables-alerter-z5w75"
Jul 30 17:00:25.821250 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.821223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4njv\" (UniqueName: \"kubernetes.io/projected/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-kube-api-access-r4njv\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:25.904910 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.904880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-run-multus-certs\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.905029 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.904925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qt7g\" (UniqueName: \"kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g\") pod \"network-check-target-59w8z\" (UID: \"b2e74fdd-1e27-4058-9fd2-c45fa2071573\") " pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:25.905029 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.904969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.905029 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.904996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-run-k8s-cni-cncf-io\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.905029 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-var-lib-cni-bin\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.905255 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-var-lib-cni-multus\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.905255 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905076    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e8be5d1-1706-4b21-90b8-2e502085e034-konnectivity-ca\") pod \"konnectivity-agent-zpbkp\" (UID: \"3e8be5d1-1706-4b21-90b8-2e502085e034\") " pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:25.905255 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905103    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-os-release\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.905255 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-var-lib-kubelet\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.905255 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-system-cni-dir\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.905255 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41d50b58-6804-479b-a731-a2e3e4d3b2cd-serviceca\") pod \"node-ca-98hsx\" (UID: \"41d50b58-6804-479b-a731-a2e3e4d3b2cd\") " pod="openshift-image-registry/node-ca-98hsx"
Jul 30 17:00:25.905255 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905202    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-sys\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.905255 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77466359-549d-44f7-bfd1-feae2b80d29c-etc-tuned\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.905255 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-hostroot\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905275    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-cnibin\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905298    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-systemd\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905330    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-lib-modules\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905354    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-os-release\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e8be5d1-1706-4b21-90b8-2e502085e034-agent-certs\") pod \"konnectivity-agent-zpbkp\" (UID: \"3e8be5d1-1706-4b21-90b8-2e502085e034\") " pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-sysctl-conf\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-host\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-cni-dir\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-socket-dir-parent\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llltq\" (UniqueName: \"kubernetes.io/projected/41d50b58-6804-479b-a731-a2e3e4d3b2cd-kube-api-access-llltq\") pod \"node-ca-98hsx\" (UID: \"41d50b58-6804-479b-a731-a2e3e4d3b2cd\") " pod="openshift-image-registry/node-ca-98hsx"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58ghc\" (UniqueName: \"kubernetes.io/projected/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-kube-api-access-58ghc\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ed19618-5096-494b-b51f-d80f84f2b7a9-dbus\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-modprobe-d\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905615    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77466359-549d-44f7-bfd1-feae2b80d29c-tmp\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf4n8\" (UniqueName: \"kubernetes.io/projected/77466359-549d-44f7-bfd1-feae2b80d29c-kube-api-access-wf4n8\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905679    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-cnibin\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41d50b58-6804-479b-a731-a2e3e4d3b2cd-host\") pod \"node-ca-98hsx\" (UID: \"41d50b58-6804-479b-a731-a2e3e4d3b2cd\") " pod="openshift-image-registry/node-ca-98hsx"
Jul 30 17:00:25.905741 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ed19618-5096-494b-b51f-d80f84f2b7a9-kubelet-config\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-run\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-daemon-config\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-sysctl-d\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-cni-binary-copy\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-conf-dir\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905890    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-system-cni-dir\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-var-lib-kubelet\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905921    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-etc-kubernetes\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-cni-binary-copy\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905958    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpmsw\" (UniqueName: \"kubernetes.io/projected/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-kube-api-access-xpmsw\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.905989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-sysconfig\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.906015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-kubernetes\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.906042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-run-netns\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.906739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.906133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-run-netns\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.907691 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.906179    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-run-multus-certs\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.907691 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.906836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.907691 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.906889    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-run-k8s-cni-cncf-io\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.907691 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.906926    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-var-lib-cni-bin\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.907691 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.906952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-var-lib-cni-multus\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.907691 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.907316    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e8be5d1-1706-4b21-90b8-2e502085e034-konnectivity-ca\") pod \"konnectivity-agent-zpbkp\" (UID: \"3e8be5d1-1706-4b21-90b8-2e502085e034\") " pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:25.907691 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.907369    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-os-release\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.907691 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.907408    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-var-lib-kubelet\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.907691 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.907452    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-system-cni-dir\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.908103 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.907874    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/41d50b58-6804-479b-a731-a2e3e4d3b2cd-serviceca\") pod \"node-ca-98hsx\" (UID: \"41d50b58-6804-479b-a731-a2e3e4d3b2cd\") " pod="openshift-image-registry/node-ca-98hsx"
Jul 30 17:00:25.908103 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.907940    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-sys\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.908103 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.907981    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-cnibin\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.908103 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.907981    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41d50b58-6804-479b-a731-a2e3e4d3b2cd-host\") pod \"node-ca-98hsx\" (UID: \"41d50b58-6804-479b-a731-a2e3e4d3b2cd\") " pod="openshift-image-registry/node-ca-98hsx"
Jul 30 17:00:25.908103 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.908036    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-hostroot\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.908103 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.908074    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-cnibin\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.908392 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.908118    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-systemd\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.908392 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.908229    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-lib-modules\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.908392 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.908287    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-os-release\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.908600 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.908429    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.909177 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.909036    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-sysctl-conf\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.909177 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.909100    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-host\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.909285 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.909217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-cni-dir\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.909285 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.909266    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-socket-dir-parent\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.909375 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.909357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-modprobe-d\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.909699 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.909669    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ed19618-5096-494b-b51f-d80f84f2b7a9-dbus\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:25.910138 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.910084    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-conf-dir\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.910221 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.910145    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ed19618-5096-494b-b51f-d80f84f2b7a9-kubelet-config\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:25.910221 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.910189    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-run\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.910735 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.910712    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-multus-daemon-config\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.910886 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.910864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.910962 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:25.910950    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:25.911018 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:25.911002    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret podName:9ed19618-5096-494b-b51f-d80f84f2b7a9 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:26.410984858 +0000 UTC m=+3.140597343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret") pod "global-pull-secret-syncer-zsm4g" (UID: "9ed19618-5096-494b-b51f-d80f84f2b7a9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:25.911257 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.911237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-sysctl-d\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.911733 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.911710    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-cni-binary-copy\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.911909 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:25.911890    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:25.911984 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:25.911916    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:25.911984 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:25.911929    2561 projected.go:196] Error preparing data for projected volume kube-api-access-2qt7g for pod openshift-network-diagnostics/network-check-target-59w8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:25.911984 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:25.911981    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g podName:b2e74fdd-1e27-4058-9fd2-c45fa2071573 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:26.411965536 +0000 UTC m=+3.141578036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2qt7g" (UniqueName: "kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g") pod "network-check-target-59w8z" (UID: "b2e74fdd-1e27-4058-9fd2-c45fa2071573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:25.912288 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.912235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-sysconfig\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.912505 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.912482    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-cni-binary-copy\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.912581 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.912563    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-system-cni-dir\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.912679 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.912611    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-host-var-lib-kubelet\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.912724 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.912677    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-etc-kubernetes\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.912724 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.912688    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77466359-549d-44f7-bfd1-feae2b80d29c-etc-kubernetes\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.915222 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.914795    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e8be5d1-1706-4b21-90b8-2e502085e034-agent-certs\") pod \"konnectivity-agent-zpbkp\" (UID: \"3e8be5d1-1706-4b21-90b8-2e502085e034\") " pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:25.915665 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.915641    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77466359-549d-44f7-bfd1-feae2b80d29c-tmp\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.915951 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.915896    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77466359-549d-44f7-bfd1-feae2b80d29c-etc-tuned\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.918222 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.918201    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llltq\" (UniqueName: \"kubernetes.io/projected/41d50b58-6804-479b-a731-a2e3e4d3b2cd-kube-api-access-llltq\") pod \"node-ca-98hsx\" (UID: \"41d50b58-6804-479b-a731-a2e3e4d3b2cd\") " pod="openshift-image-registry/node-ca-98hsx"
Jul 30 17:00:25.918419 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.918393    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58ghc\" (UniqueName: \"kubernetes.io/projected/61d58ea8-bcd8-4e2b-a42a-2f352f966a26-kube-api-access-58ghc\") pod \"multus-additional-cni-plugins-7rt6d\" (UID: \"61d58ea8-bcd8-4e2b-a42a-2f352f966a26\") " pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:25.923343 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.923321    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf4n8\" (UniqueName: \"kubernetes.io/projected/77466359-549d-44f7-bfd1-feae2b80d29c-kube-api-access-wf4n8\") pod \"tuned-6ncrg\" (UID: \"77466359-549d-44f7-bfd1-feae2b80d29c\") " pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:25.925445 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.925426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpmsw\" (UniqueName: \"kubernetes.io/projected/5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb-kube-api-access-xpmsw\") pod \"multus-d4rpt\" (UID: \"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb\") " pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:25.993428 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:25.993402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z5w75"
Jul 30 17:00:26.004529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.004507    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:26.013635 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.013608    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7"
Jul 30 17:00:26.015574 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:26.015520    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbb4c7d_0db6_445e_8460_82ba99d62c2b.slice/crio-3481d4df84dc0f79b37b4d161b5b64c684938d73e03437cdbfd21adc7ed8bcd6 WatchSource:0}: Error finding container 3481d4df84dc0f79b37b4d161b5b64c684938d73e03437cdbfd21adc7ed8bcd6: Status 404 returned error can't find the container with id 3481d4df84dc0f79b37b4d161b5b64c684938d73e03437cdbfd21adc7ed8bcd6
Jul 30 17:00:26.016911 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:26.016882    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0114f8e3_aa50_42e7_94f1_b0394d76da17.slice/crio-f296bd57cf8b093c589beb752dc8c7ae0e2393059ccd1bd1cc1334a25c23175a WatchSource:0}: Error finding container f296bd57cf8b093c589beb752dc8c7ae0e2393059ccd1bd1cc1334a25c23175a: Status 404 returned error can't find the container with id f296bd57cf8b093c589beb752dc8c7ae0e2393059ccd1bd1cc1334a25c23175a
Jul 30 17:00:26.024006 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.023980    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w95np"
Jul 30 17:00:26.027391 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:26.027365    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c5bcbd_1ac9_4b2b_b37c_b15324b6a5e6.slice/crio-538e468eb1637ca4e6fd826f29ba38b9db4880cd45e2e68c28d269d8a20403b6 WatchSource:0}: Error finding container 538e468eb1637ca4e6fd826f29ba38b9db4880cd45e2e68c28d269d8a20403b6: Status 404 returned error can't find the container with id 538e468eb1637ca4e6fd826f29ba38b9db4880cd45e2e68c28d269d8a20403b6
Jul 30 17:00:26.029826 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.029802    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d4rpt"
Jul 30 17:00:26.035787 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:26.035761    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dccf377_bcac_4887_92eb_672c457457ad.slice/crio-aca8979aa1d806248d1538c5ae050d34ca477e2df11468c77f57f1327b20c3e1 WatchSource:0}: Error finding container aca8979aa1d806248d1538c5ae050d34ca477e2df11468c77f57f1327b20c3e1: Status 404 returned error can't find the container with id aca8979aa1d806248d1538c5ae050d34ca477e2df11468c77f57f1327b20c3e1
Jul 30 17:00:26.037001 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.036984    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:26.043780 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:26.043753    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eaf9a96_2e16_4093_b5f1_9a8ab242b1eb.slice/crio-45d09e8aa401e52dfeab6cfe10ca30196cdcd23f8df8f2d38c5546efe162ef5d WatchSource:0}: Error finding container 45d09e8aa401e52dfeab6cfe10ca30196cdcd23f8df8f2d38c5546efe162ef5d: Status 404 returned error can't find the container with id 45d09e8aa401e52dfeab6cfe10ca30196cdcd23f8df8f2d38c5546efe162ef5d
Jul 30 17:00:26.045003 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.044827    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7rt6d"
Jul 30 17:00:26.054689 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.054221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6ncrg"
Jul 30 17:00:26.055000 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:26.054894    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8be5d1_1706_4b21_90b8_2e502085e034.slice/crio-7e0d562ba57ba171a294ec4e7e1d789084905c3d9e633d082c155bb228a21368 WatchSource:0}: Error finding container 7e0d562ba57ba171a294ec4e7e1d789084905c3d9e633d082c155bb228a21368: Status 404 returned error can't find the container with id 7e0d562ba57ba171a294ec4e7e1d789084905c3d9e633d082c155bb228a21368
Jul 30 17:00:26.057299 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:26.057256    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d58ea8_bcd8_4e2b_a42a_2f352f966a26.slice/crio-d516bc4dd8ef03f8471332f5438c5a5132794f34c89fc0c39055602866633191 WatchSource:0}: Error finding container d516bc4dd8ef03f8471332f5438c5a5132794f34c89fc0c39055602866633191: Status 404 returned error can't find the container with id d516bc4dd8ef03f8471332f5438c5a5132794f34c89fc0c39055602866633191
Jul 30 17:00:26.061944 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.061912    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-98hsx"
Jul 30 17:00:26.067052 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:26.067027    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77466359_549d_44f7_bfd1_feae2b80d29c.slice/crio-78d83b79e7568fc35dd77fe72a8404da7263c97643c365d092e1888d053975a7 WatchSource:0}: Error finding container 78d83b79e7568fc35dd77fe72a8404da7263c97643c365d092e1888d053975a7: Status 404 returned error can't find the container with id 78d83b79e7568fc35dd77fe72a8404da7263c97643c365d092e1888d053975a7
Jul 30 17:00:26.073688 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:00:26.073448    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d50b58_6804_479b_a731_a2e3e4d3b2cd.slice/crio-d06c5b6d9dbc9029f237973e7505e56ee7714768a14e2b9fac8dc9c684d99d15 WatchSource:0}: Error finding container d06c5b6d9dbc9029f237973e7505e56ee7714768a14e2b9fac8dc9c684d99d15: Status 404 returned error can't find the container with id d06c5b6d9dbc9029f237973e7505e56ee7714768a14e2b9fac8dc9c684d99d15
Jul 30 17:00:26.310190 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.310104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:26.310368 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:26.310254    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:26.310368 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:26.310339    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs podName:6e3bd573-f6fa-4ab5-8aff-d0c113a700ac nodeName:}" failed. No retries permitted until 2026-07-30 17:00:27.31031563 +0000 UTC m=+4.039928111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs") pod "network-metrics-daemon-8h2br" (UID: "6e3bd573-f6fa-4ab5-8aff-d0c113a700ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:26.411358 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.411319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:26.411520 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:26.411478    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:26.411585 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:26.411549    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret podName:9ed19618-5096-494b-b51f-d80f84f2b7a9 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:27.411532026 +0000 UTC m=+4.141144506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret") pod "global-pull-secret-syncer-zsm4g" (UID: "9ed19618-5096-494b-b51f-d80f84f2b7a9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:26.511800 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.511762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qt7g\" (UniqueName: \"kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g\") pod \"network-check-target-59w8z\" (UID: \"b2e74fdd-1e27-4058-9fd2-c45fa2071573\") " pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:26.511939 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:26.511926    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:26.511996 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:26.511944    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:26.511996 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:26.511958    2561 projected.go:196] Error preparing data for projected volume kube-api-access-2qt7g for pod openshift-network-diagnostics/network-check-target-59w8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:26.512091 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:26.512019    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g podName:b2e74fdd-1e27-4058-9fd2-c45fa2071573 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:27.512000908 +0000 UTC m=+4.241613390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qt7g" (UniqueName: "kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g") pod "network-check-target-59w8z" (UID: "b2e74fdd-1e27-4058-9fd2-c45fa2071573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:26.747526 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.747374    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 16:55:26 +0000 UTC" deadline="2028-01-15 05:44:05.440402539 +0000 UTC"
Jul 30 17:00:26.747526 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.747435    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12804h43m38.692972927s"
Jul 30 17:00:26.795917 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.795887    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:26.796072 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:26.795997    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:26.811971 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.811916    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zpbkp" event={"ID":"3e8be5d1-1706-4b21-90b8-2e502085e034","Type":"ContainerStarted","Data":"7e0d562ba57ba171a294ec4e7e1d789084905c3d9e633d082c155bb228a21368"}
Jul 30 17:00:26.813303 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.813274    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d4rpt" event={"ID":"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb","Type":"ContainerStarted","Data":"45d09e8aa401e52dfeab6cfe10ca30196cdcd23f8df8f2d38c5546efe162ef5d"}
Jul 30 17:00:26.815757 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.815725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w95np" event={"ID":"0dccf377-bcac-4887-92eb-672c457457ad","Type":"ContainerStarted","Data":"aca8979aa1d806248d1538c5ae050d34ca477e2df11468c77f57f1327b20c3e1"}
Jul 30 17:00:26.817395 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.817368    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb" event={"ID":"0114f8e3-aa50-42e7-94f1-b0394d76da17","Type":"ContainerStarted","Data":"f296bd57cf8b093c589beb752dc8c7ae0e2393059ccd1bd1cc1334a25c23175a"}
Jul 30 17:00:26.819230 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.819205    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z5w75" event={"ID":"1dbb4c7d-0db6-445e-8460-82ba99d62c2b","Type":"ContainerStarted","Data":"3481d4df84dc0f79b37b4d161b5b64c684938d73e03437cdbfd21adc7ed8bcd6"}
Jul 30 17:00:26.820462 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.820436    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6ncrg" event={"ID":"77466359-549d-44f7-bfd1-feae2b80d29c","Type":"ContainerStarted","Data":"78d83b79e7568fc35dd77fe72a8404da7263c97643c365d092e1888d053975a7"}
Jul 30 17:00:26.821942 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.821917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7" event={"ID":"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6","Type":"ContainerStarted","Data":"538e468eb1637ca4e6fd826f29ba38b9db4880cd45e2e68c28d269d8a20403b6"}
Jul 30 17:00:26.823351 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.823327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-98hsx" event={"ID":"41d50b58-6804-479b-a731-a2e3e4d3b2cd","Type":"ContainerStarted","Data":"d06c5b6d9dbc9029f237973e7505e56ee7714768a14e2b9fac8dc9c684d99d15"}
Jul 30 17:00:26.824574 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:26.824529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rt6d" event={"ID":"61d58ea8-bcd8-4e2b-a42a-2f352f966a26","Type":"ContainerStarted","Data":"d516bc4dd8ef03f8471332f5438c5a5132794f34c89fc0c39055602866633191"}
Jul 30 17:00:27.317912 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:27.317878    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:27.318061 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:27.318030    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:27.318132 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:27.318098    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs podName:6e3bd573-f6fa-4ab5-8aff-d0c113a700ac nodeName:}" failed. No retries permitted until 2026-07-30 17:00:29.318076505 +0000 UTC m=+6.047688995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs") pod "network-metrics-daemon-8h2br" (UID: "6e3bd573-f6fa-4ab5-8aff-d0c113a700ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:27.419448 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:27.418853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:27.419448 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:27.419011    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:27.419448 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:27.419072    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret podName:9ed19618-5096-494b-b51f-d80f84f2b7a9 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:29.41905518 +0000 UTC m=+6.148667662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret") pod "global-pull-secret-syncer-zsm4g" (UID: "9ed19618-5096-494b-b51f-d80f84f2b7a9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:27.519642 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:27.519590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qt7g\" (UniqueName: \"kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g\") pod \"network-check-target-59w8z\" (UID: \"b2e74fdd-1e27-4058-9fd2-c45fa2071573\") " pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:27.519828 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:27.519771    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:27.519828 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:27.519798    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:27.519828 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:27.519813    2561 projected.go:196] Error preparing data for projected volume kube-api-access-2qt7g for pod openshift-network-diagnostics/network-check-target-59w8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:27.520000 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:27.519873    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g podName:b2e74fdd-1e27-4058-9fd2-c45fa2071573 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:29.519853634 +0000 UTC m=+6.249466119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qt7g" (UniqueName: "kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g") pod "network-check-target-59w8z" (UID: "b2e74fdd-1e27-4058-9fd2-c45fa2071573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:27.747689 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:27.747653    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 16:55:26 +0000 UTC" deadline="2028-03-11 22:25:16.256951783 +0000 UTC"
Jul 30 17:00:27.748082 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:27.747690    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14165h24m48.509266139s"
Jul 30 17:00:27.797198 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:27.796796    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:27.797198 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:27.797141    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:27.800689 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:27.798741    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:27.800689 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:27.798866    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:28.795868 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:28.795777    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:28.796342 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:28.795912    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:28.840031 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:28.839462    2561 generic.go:356] "Generic (PLEG): container finished" podID="f8fd3bb6c30f22271f3ed6f5503e00a6" containerID="d68567a91c6043dbc58da3d29fa2d70b07bd14a165f38cc7f3d38ca2b720b4e9" exitCode=0
Jul 30 17:00:28.840031 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:28.839517    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal" event={"ID":"f8fd3bb6c30f22271f3ed6f5503e00a6","Type":"ContainerDied","Data":"d68567a91c6043dbc58da3d29fa2d70b07bd14a165f38cc7f3d38ca2b720b4e9"}
Jul 30 17:00:28.845497 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:28.845469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal" event={"ID":"e2d5e43724ffee48daaf282f2e083298","Type":"ContainerStarted","Data":"107381d0eef0336596d96894e9abf5fdf6d8032ad92255f92d2dce543de95c14"}
Jul 30 17:00:29.336943 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:29.336902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:29.337132 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:29.337107    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:29.337200 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:29.337171    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs podName:6e3bd573-f6fa-4ab5-8aff-d0c113a700ac nodeName:}" failed. No retries permitted until 2026-07-30 17:00:33.337152985 +0000 UTC m=+10.066765466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs") pod "network-metrics-daemon-8h2br" (UID: "6e3bd573-f6fa-4ab5-8aff-d0c113a700ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:29.437904 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:29.437864    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:29.438103 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:29.438044    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:29.438179 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:29.438111    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret podName:9ed19618-5096-494b-b51f-d80f84f2b7a9 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:33.438092481 +0000 UTC m=+10.167704974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret") pod "global-pull-secret-syncer-zsm4g" (UID: "9ed19618-5096-494b-b51f-d80f84f2b7a9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:29.539214 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:29.539174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qt7g\" (UniqueName: \"kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g\") pod \"network-check-target-59w8z\" (UID: \"b2e74fdd-1e27-4058-9fd2-c45fa2071573\") " pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:29.544868 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:29.544827    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:29.544868 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:29.544873    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:29.545060 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:29.544899    2561 projected.go:196] Error preparing data for projected volume kube-api-access-2qt7g for pod openshift-network-diagnostics/network-check-target-59w8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:29.545060 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:29.545002    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g podName:b2e74fdd-1e27-4058-9fd2-c45fa2071573 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:33.544944574 +0000 UTC m=+10.274557070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qt7g" (UniqueName: "kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g") pod "network-check-target-59w8z" (UID: "b2e74fdd-1e27-4058-9fd2-c45fa2071573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:29.796099 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:29.796014    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:29.796559 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:29.796159    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:29.796642 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:29.796578    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:29.796788 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:29.796761    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:30.795349 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:30.795321    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:30.795532 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:30.795435    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:31.795701 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:31.795669    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:31.796187 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:31.795821    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:31.796326 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:31.796302    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:31.796456 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:31.796414    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:32.795277 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:32.795242    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:32.795468 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:32.795365    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:33.372490 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:33.372456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:33.373012 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:33.372651    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:33.373012 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:33.372737    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs podName:6e3bd573-f6fa-4ab5-8aff-d0c113a700ac nodeName:}" failed. No retries permitted until 2026-07-30 17:00:41.372714756 +0000 UTC m=+18.102327265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs") pod "network-metrics-daemon-8h2br" (UID: "6e3bd573-f6fa-4ab5-8aff-d0c113a700ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:33.473347 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:33.473294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:33.473527 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:33.473459    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:33.473527 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:33.473523    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret podName:9ed19618-5096-494b-b51f-d80f84f2b7a9 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:41.47350388 +0000 UTC m=+18.203116375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret") pod "global-pull-secret-syncer-zsm4g" (UID: "9ed19618-5096-494b-b51f-d80f84f2b7a9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:33.574295 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:33.574261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qt7g\" (UniqueName: \"kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g\") pod \"network-check-target-59w8z\" (UID: \"b2e74fdd-1e27-4058-9fd2-c45fa2071573\") " pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:33.574485 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:33.574432    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:33.574485 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:33.574452    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:33.574485 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:33.574464    2561 projected.go:196] Error preparing data for projected volume kube-api-access-2qt7g for pod openshift-network-diagnostics/network-check-target-59w8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:33.574687 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:33.574524    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g podName:b2e74fdd-1e27-4058-9fd2-c45fa2071573 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:41.57450366 +0000 UTC m=+18.304116146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qt7g" (UniqueName: "kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g") pod "network-check-target-59w8z" (UID: "b2e74fdd-1e27-4058-9fd2-c45fa2071573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:33.799200 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:33.798567    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:33.799200 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:33.798708    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:33.799200 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:33.799047    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:33.799200 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:33.799146    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:34.795014 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:34.794976    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:34.795503 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:34.795073    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:35.798370 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:35.797556    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:35.798370 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:35.797718    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:35.798370 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:35.798202    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:35.798370 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:35.798306    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:36.795739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:36.795705    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:36.795903 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:36.795798    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:37.795605 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:37.795574    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:37.795957 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:37.795676    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:37.795957 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:37.795730    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:37.795957 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:37.795829    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:38.795886 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:38.795852    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:38.796313 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:38.795971    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:39.795529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:39.795493    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:39.795724 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:39.795532    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:39.795724 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:39.795621    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:39.795832 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:39.795795    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:40.795384 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:40.795354    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:40.795892 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:40.795476    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:41.436774 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:41.436744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:41.436967 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:41.436875    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:41.436967 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:41.436936    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs podName:6e3bd573-f6fa-4ab5-8aff-d0c113a700ac nodeName:}" failed. No retries permitted until 2026-07-30 17:00:57.436915941 +0000 UTC m=+34.166528419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs") pod "network-metrics-daemon-8h2br" (UID: "6e3bd573-f6fa-4ab5-8aff-d0c113a700ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:41.537776 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:41.537744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:41.537930 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:41.537881    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:41.537930 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:41.537927    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret podName:9ed19618-5096-494b-b51f-d80f84f2b7a9 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:57.537914024 +0000 UTC m=+34.267526499 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret") pod "global-pull-secret-syncer-zsm4g" (UID: "9ed19618-5096-494b-b51f-d80f84f2b7a9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:41.639041 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:41.639011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qt7g\" (UniqueName: \"kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g\") pod \"network-check-target-59w8z\" (UID: \"b2e74fdd-1e27-4058-9fd2-c45fa2071573\") " pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:41.639191 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:41.639143    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:41.639191 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:41.639162    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:41.639191 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:41.639173    2561 projected.go:196] Error preparing data for projected volume kube-api-access-2qt7g for pod openshift-network-diagnostics/network-check-target-59w8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:41.639354 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:41.639234    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g podName:b2e74fdd-1e27-4058-9fd2-c45fa2071573 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:57.639218335 +0000 UTC m=+34.368830829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qt7g" (UniqueName: "kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g") pod "network-check-target-59w8z" (UID: "b2e74fdd-1e27-4058-9fd2-c45fa2071573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:41.795879 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:41.795853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:41.796212 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:41.795950    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:41.796212 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:41.796039    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:41.796212 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:41.796137    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:42.795909 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:42.795878    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:42.796321 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:42.795973    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:43.796880 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:43.796838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:43.797311 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:43.796965    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:43.797311 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:43.797000    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:43.797311 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:43.797085    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:44.795259 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:44.795226    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:44.795413 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:44.795362    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:45.795534 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:45.795499    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:45.795534 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:45.795523    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:45.796050 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:45.795653    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:45.796050 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:45.795772    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:46.795469 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.795208    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:46.795649 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:46.795566    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:46.886008 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.885980    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-98hsx" event={"ID":"41d50b58-6804-479b-a731-a2e3e4d3b2cd","Type":"ContainerStarted","Data":"e851b250f5eeff9158ac74c68a587ae46f88d5aa4e3775c8b365fb828d2cddbc"}
Jul 30 17:00:46.888626 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.888604    2561 generic.go:356] "Generic (PLEG): container finished" podID="61d58ea8-bcd8-4e2b-a42a-2f352f966a26" containerID="957c28b5e8f0b4fe370e1ca519b49f7bc293bb801bbdc5ae2aca7bf757c33962" exitCode=0
Jul 30 17:00:46.888759 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.888625    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rt6d" event={"ID":"61d58ea8-bcd8-4e2b-a42a-2f352f966a26","Type":"ContainerDied","Data":"957c28b5e8f0b4fe370e1ca519b49f7bc293bb801bbdc5ae2aca7bf757c33962"}
Jul 30 17:00:46.890389 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.890362    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zpbkp" event={"ID":"3e8be5d1-1706-4b21-90b8-2e502085e034","Type":"ContainerStarted","Data":"49cd1fb0ca0b5647d53f0b03e3b42ea0f6bd5b86e1e0ae5befc525aa732f2dac"}
Jul 30 17:00:46.892120 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.892098    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d4rpt" event={"ID":"5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb","Type":"ContainerStarted","Data":"d6654093221045b2141f921bce74878e96e4798eaf70489a09a0f739f7e39b87"}
Jul 30 17:00:46.893467 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.893450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w95np" event={"ID":"0dccf377-bcac-4887-92eb-672c457457ad","Type":"ContainerStarted","Data":"116a570939c98236efd11d71374265c61832c6d477d2a7d80b1d8617477680d3"}
Jul 30 17:00:46.897315 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.897297    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb" event={"ID":"0114f8e3-aa50-42e7-94f1-b0394d76da17","Type":"ContainerStarted","Data":"1fc24e9495db87810535c9d95048bc8202065f05cc4f381bdd2d60db00fbf8a5"}
Jul 30 17:00:46.897401 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.897364    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb" event={"ID":"0114f8e3-aa50-42e7-94f1-b0394d76da17","Type":"ContainerStarted","Data":"e2408e43727e61244cec20875445564e3eead6fb01c0025280f70dcd84715412"}
Jul 30 17:00:46.897445 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.897414    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb" event={"ID":"0114f8e3-aa50-42e7-94f1-b0394d76da17","Type":"ContainerStarted","Data":"0fc9ec843f72244fb07e764241e69929132615c12d674065f929cee05fd1df75"}
Jul 30 17:00:46.898859 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.898835    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal" event={"ID":"f8fd3bb6c30f22271f3ed6f5503e00a6","Type":"ContainerStarted","Data":"497a934665541bfad26899b47ca93c422a80ead96d619e54542aab6cb34929c6"}
Jul 30 17:00:46.900384 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.900366    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6ncrg" event={"ID":"77466359-549d-44f7-bfd1-feae2b80d29c","Type":"ContainerStarted","Data":"dd67e368f870098562b980f4540435f5fd944d415937a12d5f02f5ee7c23fa67"}
Jul 30 17:00:46.900704 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.900662    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-57.ec2.internal" podStartSLOduration=21.900645832 podStartE2EDuration="21.900645832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:00:28.877505442 +0000 UTC m=+5.607117943" watchObservedRunningTime="2026-07-30 17:00:46.900645832 +0000 UTC m=+23.630258331"
Jul 30 17:00:46.900864 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.900834    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-98hsx" podStartSLOduration=1.6104546119999998 podStartE2EDuration="21.900827516s" totalImagesPullingTime="20.290372904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:00:46.90025418 +0000 UTC m=+23.629866901" watchObservedRunningTime="2026-07-30 17:00:46.900827516 +0000 UTC m=+23.630440091"
Jul 30 17:00:46.901763 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.901746    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7" event={"ID":"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6","Type":"ContainerStarted","Data":"fd0094118961d5c06234fa01621e10a9a2c120f1ca49e54a038dacced25db678"}
Jul 30 17:00:46.944610 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.944572    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-57.ec2.internal" podStartSLOduration=21.944561125 podStartE2EDuration="21.944561125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:00:46.944333084 +0000 UTC m=+23.673945581" watchObservedRunningTime="2026-07-30 17:00:46.944561125 +0000 UTC m=+23.674173614"
Jul 30 17:00:46.959903 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.959863    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w95np" podStartSLOduration=7.269501421 podStartE2EDuration="22.959852685s" totalImagesPullingTime="15.690351264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:00:46.959486379 +0000 UTC m=+23.689098877" watchObservedRunningTime="2026-07-30 17:00:46.959852685 +0000 UTC m=+23.689465183"
Jul 30 17:00:46.976571 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.976521    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d4rpt" podStartSLOduration=2.641968892 podStartE2EDuration="22.976511215s" totalImagesPullingTime="20.334542323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:00:46.976054134 +0000 UTC m=+23.705666635" watchObservedRunningTime="2026-07-30 17:00:46.976511215 +0000 UTC m=+23.706123714"
Jul 30 17:00:46.991263 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:46.991233    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zpbkp" podStartSLOduration=2.68181911 podStartE2EDuration="22.991223145s" totalImagesPullingTime="20.309404035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:00:46.990742803 +0000 UTC m=+23.720355300" watchObservedRunningTime="2026-07-30 17:00:46.991223145 +0000 UTC m=+23.720835670"
Jul 30 17:00:47.795186 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:47.795164    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:47.795307 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:47.795283    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:47.795376 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:47.795329    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:47.795439 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:47.795423    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:47.908387 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:47.908357    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb" event={"ID":"0114f8e3-aa50-42e7-94f1-b0394d76da17","Type":"ContainerStarted","Data":"2940cf3a1865d0ac69df0864fda7fa3132b2ccfe6ea5ee27837922493b37eb86"}
Jul 30 17:00:47.908765 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:47.908460    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb" event={"ID":"0114f8e3-aa50-42e7-94f1-b0394d76da17","Type":"ContainerStarted","Data":"93724d6e1e4f0a7270a4638044c670e8ffda8e57206c2697b1bdcf7b1bfe405d"}
Jul 30 17:00:47.908765 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:47.908517    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb" event={"ID":"0114f8e3-aa50-42e7-94f1-b0394d76da17","Type":"ContainerStarted","Data":"05f183c505872f6f5951c8bc6227190d446c1af2873585b51b9f0ad230ef85f4"}
Jul 30 17:00:47.910905 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:47.910881    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z5w75" event={"ID":"1dbb4c7d-0db6-445e-8460-82ba99d62c2b","Type":"ContainerStarted","Data":"8fca86e67d80e341bbff5990f62dddd617ec1d6cd353d61e015889b6aab83ae4"}
Jul 30 17:00:47.914506 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:47.914483    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 17:00:47.926287 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:47.926241    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z5w75" podStartSLOduration=3.574129306 podStartE2EDuration="23.926222625s" totalImagesPullingTime="20.352093319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:00:47.926122624 +0000 UTC m=+24.655735121" watchObservedRunningTime="2026-07-30 17:00:47.926222625 +0000 UTC m=+24.655835124"
Jul 30 17:00:47.926443 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:47.926421    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6ncrg" podStartSLOduration=2.6268388209999998 podStartE2EDuration="22.92641507s" totalImagesPullingTime="20.299576249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:00:47.008857601 +0000 UTC m=+23.738470098" watchObservedRunningTime="2026-07-30 17:00:47.92641507 +0000 UTC m=+24.656027571"
Jul 30 17:00:48.762878 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:48.762770    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T17:00:47.914503513Z","UUID":"c1e52740-e1b8-4f71-bf16-47fd3b4572a5","Handler":null,"Name":"","Endpoint":""}
Jul 30 17:00:48.764385 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:48.764364    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 17:00:48.764532 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:48.764405    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 17:00:48.795881 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:48.795859    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:48.796002 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:48.795967    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:48.920231 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:48.920201    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7" event={"ID":"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6","Type":"ContainerStarted","Data":"e9c96529a947be5d4820482cf7793940d5392980bf3fb259fccabe278d2b888e"}
Jul 30 17:00:49.427163 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:49.427138    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:49.427912 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:49.427895    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:49.795795 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:49.795637    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:49.795904 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:49.795655    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:49.795904 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:49.795886    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:49.796010 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:49.795949    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:49.923934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:49.923899    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7" event={"ID":"c8c5bcbd-1ac9-4b2b-b37c-b15324b6a5e6","Type":"ContainerStarted","Data":"c4ca3570d810360c2a038340eef2d5f7159071080be810d9f4ead6c26ec8f0d4"}
Jul 30 17:00:49.927948 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:49.927918    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb" event={"ID":"0114f8e3-aa50-42e7-94f1-b0394d76da17","Type":"ContainerStarted","Data":"6d6c54bbe983e14d9e3ad56f4dcf6c850735930f68e2f63ca1421229763eb0a6"}
Jul 30 17:00:49.928208 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:49.928186    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:49.928698 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:49.928672    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zpbkp"
Jul 30 17:00:49.942527 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:49.942489    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vdcq7" podStartSLOduration=2.546999069 podStartE2EDuration="25.94247169s" totalImagesPullingTime="23.395472621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:00:49.942038303 +0000 UTC m=+26.671650815" watchObservedRunningTime="2026-07-30 17:00:49.94247169 +0000 UTC m=+26.672084189"
Jul 30 17:00:50.795520 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:50.795495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:50.795775 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:50.795600    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:51.795964 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:51.795836    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:51.797646 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:51.795972    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:51.797646 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:51.796456    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:51.797646 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:51.796624    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:51.936945 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:51.936746    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb" event={"ID":"0114f8e3-aa50-42e7-94f1-b0394d76da17","Type":"ContainerStarted","Data":"c188dbd3f32d77ded5639093b6d8b40b737393cceb9c597535536a5ec2a7ccad"}
Jul 30 17:00:51.936945 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:51.937005    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:51.938828 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:51.938797    2561 generic.go:356] "Generic (PLEG): container finished" podID="61d58ea8-bcd8-4e2b-a42a-2f352f966a26" containerID="6241f95f7154fd703f157757115e17eeff7d4959d2f2d8ce1185dea65174ef01" exitCode=0
Jul 30 17:00:51.938963 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:51.938878    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rt6d" event={"ID":"61d58ea8-bcd8-4e2b-a42a-2f352f966a26","Type":"ContainerDied","Data":"6241f95f7154fd703f157757115e17eeff7d4959d2f2d8ce1185dea65174ef01"}
Jul 30 17:00:51.954440 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:51.954419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:51.964091 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:51.964056    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb" podStartSLOduration=7.531391589 podStartE2EDuration="27.964044192s" totalImagesPullingTime="20.432652603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:00:51.962534497 +0000 UTC m=+28.692146995" watchObservedRunningTime="2026-07-30 17:00:51.964044192 +0000 UTC m=+28.693656689"
Jul 30 17:00:52.795660 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:52.795635    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:52.795813 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:52.795723    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:52.941109 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:52.941080    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:52.941535 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:52.941154    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:52.956485 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:52.956466    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:00:53.735202 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:53.735175    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-59w8z"]
Jul 30 17:00:53.735412 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:53.735330    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:53.735462 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:53.735429    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:53.738736 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:53.738712    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8h2br"]
Jul 30 17:00:53.738845 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:53.738762    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zsm4g"]
Jul 30 17:00:53.738845 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:53.738835    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:53.738991 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:53.738910    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:53.738991 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:53.738973    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:53.739092 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:53.739033    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:53.944694 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:53.944660    2561 generic.go:356] "Generic (PLEG): container finished" podID="61d58ea8-bcd8-4e2b-a42a-2f352f966a26" containerID="fcf0743320d1d0ef180c0f25ad9ea6e52d7d17d1912117179804e9040b2ff902" exitCode=0
Jul 30 17:00:53.945114 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:53.944724    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rt6d" event={"ID":"61d58ea8-bcd8-4e2b-a42a-2f352f966a26","Type":"ContainerDied","Data":"fcf0743320d1d0ef180c0f25ad9ea6e52d7d17d1912117179804e9040b2ff902"}
Jul 30 17:00:54.795565 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:54.795524    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:54.795713 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:54.795648    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:55.795292 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:55.795142    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:55.795667 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:55.795220    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:55.795667 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:55.795357    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:55.795667 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:55.795448    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:55.951723 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:55.951660    2561 generic.go:356] "Generic (PLEG): container finished" podID="61d58ea8-bcd8-4e2b-a42a-2f352f966a26" containerID="e7358f0336b72f81b4cf695a6551fcff8d0d207133bf05091aeea59f44c9e134" exitCode=0
Jul 30 17:00:55.951723 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:55.951710    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rt6d" event={"ID":"61d58ea8-bcd8-4e2b-a42a-2f352f966a26","Type":"ContainerDied","Data":"e7358f0336b72f81b4cf695a6551fcff8d0d207133bf05091aeea59f44c9e134"}
Jul 30 17:00:56.795477 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:56.795451    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:56.795955 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:56.795564    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:57.458881 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:57.458852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:57.459053 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:57.459021    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:57.459107 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:57.459093    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs podName:6e3bd573-f6fa-4ab5-8aff-d0c113a700ac nodeName:}" failed. No retries permitted until 2026-07-30 17:01:29.459071918 +0000 UTC m=+66.188684593 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs") pod "network-metrics-daemon-8h2br" (UID: "6e3bd573-f6fa-4ab5-8aff-d0c113a700ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:00:57.559665 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:57.559630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:57.559780 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:57.559755    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:57.559837 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:57.559811    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret podName:9ed19618-5096-494b-b51f-d80f84f2b7a9 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:29.559793721 +0000 UTC m=+66.289406197 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret") pod "global-pull-secret-syncer-zsm4g" (UID: "9ed19618-5096-494b-b51f-d80f84f2b7a9") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:00:57.660505 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:57.660476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qt7g\" (UniqueName: \"kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g\") pod \"network-check-target-59w8z\" (UID: \"b2e74fdd-1e27-4058-9fd2-c45fa2071573\") " pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:57.660676 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:57.660658    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:00:57.660739 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:57.660685    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:00:57.660739 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:57.660699    2561 projected.go:196] Error preparing data for projected volume kube-api-access-2qt7g for pod openshift-network-diagnostics/network-check-target-59w8z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:57.660839 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:57.660746    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g podName:b2e74fdd-1e27-4058-9fd2-c45fa2071573 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:29.660729282 +0000 UTC m=+66.390341759 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qt7g" (UniqueName: "kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g") pod "network-check-target-59w8z" (UID: "b2e74fdd-1e27-4058-9fd2-c45fa2071573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:00:57.795924 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:57.795851    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:57.796374 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:57.795975    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zsm4g" podUID="9ed19618-5096-494b-b51f-d80f84f2b7a9"
Jul 30 17:00:57.796374 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:57.796316    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:57.796498 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:57.796419    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8h2br" podUID="6e3bd573-f6fa-4ab5-8aff-d0c113a700ac"
Jul 30 17:00:58.795491 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:58.795452    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:00:58.795691 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:58.795593    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59w8z" podUID="b2e74fdd-1e27-4058-9fd2-c45fa2071573"
Jul 30 17:00:59.112130 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.112071    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-57.ec2.internal" event="NodeReady"
Jul 30 17:00:59.112463 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.112179    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 17:00:59.145710 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.145683    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-588d4655-sz8xg"]
Jul 30 17:00:59.150964 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.150942    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.153783 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.153756    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 17:00:59.153920 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.153787    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nffnt\""
Jul 30 17:00:59.153920 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.153756    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 17:00:59.154077 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.154038    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 17:00:59.156625 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.156604    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jpxpz"]
Jul 30 17:00:59.160235 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.160215    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jlf8x"]
Jul 30 17:00:59.161875 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.161232    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.161875 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.161325    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 17:00:59.164867 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.164845    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jlf8x"
Jul 30 17:00:59.165627 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.165610    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588d4655-sz8xg"]
Jul 30 17:00:59.166989 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.166572    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72fd8\""
Jul 30 17:00:59.166989 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.166615    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 17:00:59.166989 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.166819    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 17:00:59.167327 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.167308    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 17:00:59.167327 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.167322    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hmptn\""
Jul 30 17:00:59.167455 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.167404    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 17:00:59.167455 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.167422    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 17:00:59.168848 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.168829    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jpxpz"]
Jul 30 17:00:59.172264 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.171593    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jlf8x"]
Jul 30 17:00:59.271848 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.271824    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fac44fd1-35de-46a1-b7b0-7689ec6078cc-ca-trust-extracted\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.271848 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.271851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8vxt\" (UniqueName: \"kubernetes.io/projected/c8189d07-aacf-4e6e-9d50-01259f44f2b4-kube-api-access-f8vxt\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.272095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.271884    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-image-registry-private-configuration\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.272095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.271910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8189d07-aacf-4e6e-9d50-01259f44f2b4-tmp-dir\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.272095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.271989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv8x7\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-kube-api-access-mv8x7\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.272095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.272018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqglx\" (UniqueName: \"kubernetes.io/projected/d70dea2b-c5ea-403d-9811-a21ddfe1f30f-kube-api-access-nqglx\") pod \"ingress-canary-jlf8x\" (UID: \"d70dea2b-c5ea-403d-9811-a21ddfe1f30f\") " pod="openshift-ingress-canary/ingress-canary-jlf8x"
Jul 30 17:00:59.272095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.272054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.272095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.272069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-trusted-ca\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.272387 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.272126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8189d07-aacf-4e6e-9d50-01259f44f2b4-config-volume\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.272387 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.272161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.272387 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.272219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-certificates\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.272387 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.272250    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-installation-pull-secrets\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.272387 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.272274    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-bound-sa-token\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.272387 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.272296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d70dea2b-c5ea-403d-9811-a21ddfe1f30f-cert\") pod \"ingress-canary-jlf8x\" (UID: \"d70dea2b-c5ea-403d-9811-a21ddfe1f30f\") " pod="openshift-ingress-canary/ingress-canary-jlf8x"
Jul 30 17:00:59.305342 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.305305    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zpbkp_3e8be5d1-1706-4b21-90b8-2e502085e034/konnectivity-agent/0.log" limit=1024
Jul 30 17:00:59.373242 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d70dea2b-c5ea-403d-9811-a21ddfe1f30f-cert\") pod \"ingress-canary-jlf8x\" (UID: \"d70dea2b-c5ea-403d-9811-a21ddfe1f30f\") " pod="openshift-ingress-canary/ingress-canary-jlf8x"
Jul 30 17:00:59.373242 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fac44fd1-35de-46a1-b7b0-7689ec6078cc-ca-trust-extracted\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.373446 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373245    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8vxt\" (UniqueName: \"kubernetes.io/projected/c8189d07-aacf-4e6e-9d50-01259f44f2b4-kube-api-access-f8vxt\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.373446 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-image-registry-private-configuration\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.373446 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8189d07-aacf-4e6e-9d50-01259f44f2b4-tmp-dir\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.373446 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373321    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv8x7\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-kube-api-access-mv8x7\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.373446 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqglx\" (UniqueName: \"kubernetes.io/projected/d70dea2b-c5ea-403d-9811-a21ddfe1f30f-kube-api-access-nqglx\") pod \"ingress-canary-jlf8x\" (UID: \"d70dea2b-c5ea-403d-9811-a21ddfe1f30f\") " pod="openshift-ingress-canary/ingress-canary-jlf8x"
Jul 30 17:00:59.373446 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.373446 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373407    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-trusted-ca\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.373804 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8189d07-aacf-4e6e-9d50-01259f44f2b4-config-volume\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.373804 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373480    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.373804 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-certificates\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.373804 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373572    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-installation-pull-secrets\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.373804 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-bound-sa-token\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.373804 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373641    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fac44fd1-35de-46a1-b7b0-7689ec6078cc-ca-trust-extracted\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.374089 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:59.373841    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:00:59.374089 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:59.373858    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588d4655-sz8xg: secret "image-registry-tls" not found
Jul 30 17:00:59.374089 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:59.373914    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls podName:fac44fd1-35de-46a1-b7b0-7689ec6078cc nodeName:}" failed. No retries permitted until 2026-07-30 17:00:59.873895939 +0000 UTC m=+36.603508415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls") pod "image-registry-588d4655-sz8xg" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc") : secret "image-registry-tls" not found
Jul 30 17:00:59.374089 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.373854    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8189d07-aacf-4e6e-9d50-01259f44f2b4-tmp-dir\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.374301 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:59.374112    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:00:59.374301 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:59.374160    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls podName:c8189d07-aacf-4e6e-9d50-01259f44f2b4 nodeName:}" failed. No retries permitted until 2026-07-30 17:00:59.874146122 +0000 UTC m=+36.603758612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls") pod "dns-default-jpxpz" (UID: "c8189d07-aacf-4e6e-9d50-01259f44f2b4") : secret "dns-default-metrics-tls" not found
Jul 30 17:00:59.374301 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.374182    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8189d07-aacf-4e6e-9d50-01259f44f2b4-config-volume\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.374429 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.374412    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-certificates\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.374842 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.374794    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-trusted-ca\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.378090 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.378066    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-image-registry-private-configuration\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.378474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.378441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-installation-pull-secrets\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.378603 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.378498    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d70dea2b-c5ea-403d-9811-a21ddfe1f30f-cert\") pod \"ingress-canary-jlf8x\" (UID: \"d70dea2b-c5ea-403d-9811-a21ddfe1f30f\") " pod="openshift-ingress-canary/ingress-canary-jlf8x"
Jul 30 17:00:59.384687 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.384629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8vxt\" (UniqueName: \"kubernetes.io/projected/c8189d07-aacf-4e6e-9d50-01259f44f2b4-kube-api-access-f8vxt\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.384687 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.384652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqglx\" (UniqueName: \"kubernetes.io/projected/d70dea2b-c5ea-403d-9811-a21ddfe1f30f-kube-api-access-nqglx\") pod \"ingress-canary-jlf8x\" (UID: \"d70dea2b-c5ea-403d-9811-a21ddfe1f30f\") " pod="openshift-ingress-canary/ingress-canary-jlf8x"
Jul 30 17:00:59.384687 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.384635    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-bound-sa-token\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.384875 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.384829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv8x7\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-kube-api-access-mv8x7\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.390734 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.390669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zpbkp_3e8be5d1-1706-4b21-90b8-2e502085e034/konnectivity-agent/0.log" limit=1024
Jul 30 17:00:59.482281 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.482252    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jlf8x"
Jul 30 17:00:59.795280 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.795247    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:00:59.795440 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.795290    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:00:59.798014 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.797990    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 17:00:59.799025 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.799005    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqjnm\""
Jul 30 17:00:59.799138 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.799113    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 17:00:59.878174 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.878151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:00:59.878284 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:00:59.878196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:00:59.878345 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:59.878322    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:00:59.878345 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:59.878327    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:00:59.878345 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:59.878341    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588d4655-sz8xg: secret "image-registry-tls" not found
Jul 30 17:00:59.878457 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:59.878395    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls podName:c8189d07-aacf-4e6e-9d50-01259f44f2b4 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:00.878376492 +0000 UTC m=+37.607988984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls") pod "dns-default-jpxpz" (UID: "c8189d07-aacf-4e6e-9d50-01259f44f2b4") : secret "dns-default-metrics-tls" not found
Jul 30 17:00:59.878457 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:00:59.878411    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls podName:fac44fd1-35de-46a1-b7b0-7689ec6078cc nodeName:}" failed. No retries permitted until 2026-07-30 17:01:00.87840504 +0000 UTC m=+37.608017527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls") pod "image-registry-588d4655-sz8xg" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc") : secret "image-registry-tls" not found
Jul 30 17:01:00.760153 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:00.759995    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jlf8x"]
Jul 30 17:01:00.764826 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:00.764806    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70dea2b_c5ea_403d_9811_a21ddfe1f30f.slice/crio-8b79c9ccd0eeaf342bce368e7a363d567c624de7976af47493c2a6286fb57e73 WatchSource:0}: Error finding container 8b79c9ccd0eeaf342bce368e7a363d567c624de7976af47493c2a6286fb57e73: Status 404 returned error can't find the container with id 8b79c9ccd0eeaf342bce368e7a363d567c624de7976af47493c2a6286fb57e73
Jul 30 17:01:00.795451 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:00.795429    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:01:00.797946 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:00.797905    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 17:01:00.798037 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:00.797947    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 17:01:00.798089 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:00.798050    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w7mtp\""
Jul 30 17:01:00.886053 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:00.885977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:01:00.886053 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:00.886031    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:01:00.886162 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:00.886125    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:01:00.886192 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:00.886185    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls podName:c8189d07-aacf-4e6e-9d50-01259f44f2b4 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:02.886170636 +0000 UTC m=+39.615783112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls") pod "dns-default-jpxpz" (UID: "c8189d07-aacf-4e6e-9d50-01259f44f2b4") : secret "dns-default-metrics-tls" not found
Jul 30 17:01:00.886240 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:00.886127    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:01:00.886240 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:00.886221    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588d4655-sz8xg: secret "image-registry-tls" not found
Jul 30 17:01:00.886304 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:00.886262    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls podName:fac44fd1-35de-46a1-b7b0-7689ec6078cc nodeName:}" failed. No retries permitted until 2026-07-30 17:01:02.886251018 +0000 UTC m=+39.615863494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls") pod "image-registry-588d4655-sz8xg" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc") : secret "image-registry-tls" not found
Jul 30 17:01:00.963698 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:00.963674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jlf8x" event={"ID":"d70dea2b-c5ea-403d-9811-a21ddfe1f30f","Type":"ContainerStarted","Data":"8b79c9ccd0eeaf342bce368e7a363d567c624de7976af47493c2a6286fb57e73"}
Jul 30 17:01:00.966111 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:00.966092    2561 generic.go:356] "Generic (PLEG): container finished" podID="61d58ea8-bcd8-4e2b-a42a-2f352f966a26" containerID="62bc9bb8f6b3c62b52e1afce55d07eec50702b4f98fc8447f8991d19a8a06bcd" exitCode=0
Jul 30 17:01:00.966180 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:00.966119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rt6d" event={"ID":"61d58ea8-bcd8-4e2b-a42a-2f352f966a26","Type":"ContainerDied","Data":"62bc9bb8f6b3c62b52e1afce55d07eec50702b4f98fc8447f8991d19a8a06bcd"}
Jul 30 17:01:01.971657 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:01.971621    2561 generic.go:356] "Generic (PLEG): container finished" podID="61d58ea8-bcd8-4e2b-a42a-2f352f966a26" containerID="57ddd2a4c95932a76ecea2ee4aa336d220c7955d26ac0a7875f65516f0b027b4" exitCode=0
Jul 30 17:01:01.972121 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:01.971696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rt6d" event={"ID":"61d58ea8-bcd8-4e2b-a42a-2f352f966a26","Type":"ContainerDied","Data":"57ddd2a4c95932a76ecea2ee4aa336d220c7955d26ac0a7875f65516f0b027b4"}
Jul 30 17:01:02.902845 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:02.902640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:01:02.903019 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:02.902884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:01:02.903019 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:02.902791    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:01:02.903019 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:02.902934    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588d4655-sz8xg: secret "image-registry-tls" not found
Jul 30 17:01:02.903019 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:02.902991    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls podName:fac44fd1-35de-46a1-b7b0-7689ec6078cc nodeName:}" failed. No retries permitted until 2026-07-30 17:01:06.902976002 +0000 UTC m=+43.632588478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls") pod "image-registry-588d4655-sz8xg" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc") : secret "image-registry-tls" not found
Jul 30 17:01:02.903019 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:02.903018    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:01:02.903224 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:02.903086    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls podName:c8189d07-aacf-4e6e-9d50-01259f44f2b4 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:06.903070083 +0000 UTC m=+43.632682575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls") pod "dns-default-jpxpz" (UID: "c8189d07-aacf-4e6e-9d50-01259f44f2b4") : secret "dns-default-metrics-tls" not found
Jul 30 17:01:02.976701 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:02.976681    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rt6d" event={"ID":"61d58ea8-bcd8-4e2b-a42a-2f352f966a26","Type":"ContainerStarted","Data":"57cc95a5886762eb95e30ae1d9056bb665f84952fa904361d1f45e58a93133ff"}
Jul 30 17:01:02.999941 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:02.999899    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7rt6d" podStartSLOduration=6.962921596 podStartE2EDuration="38.999880174s" totalImagesPullingTime="32.036958578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:02.998383825 +0000 UTC m=+39.727996324" watchObservedRunningTime="2026-07-30 17:01:02.999880174 +0000 UTC m=+39.729492674"
Jul 30 17:01:03.223524 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:03.223497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zpbkp_3e8be5d1-1706-4b21-90b8-2e502085e034/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:03.280793 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:03.280764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zpbkp_3e8be5d1-1706-4b21-90b8-2e502085e034/konnectivity-agent/0.log" limit=1024
Jul 30 17:01:03.980013 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:03.979983    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jlf8x" event={"ID":"d70dea2b-c5ea-403d-9811-a21ddfe1f30f","Type":"ContainerStarted","Data":"498b403e610dc9a010bf169de78eabf67792d3e9db015498e13d201166c4a96a"}
Jul 30 17:01:03.995921 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:03.995879    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jlf8x" podStartSLOduration=2.799307968 podStartE2EDuration="4.99586566s" totalImagesPullingTime="2.196557692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:03.99488503 +0000 UTC m=+40.724497561" watchObservedRunningTime="2026-07-30 17:01:03.99586566 +0000 UTC m=+40.725478158"
Jul 30 17:01:04.173298 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.173269    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-ssf4q"]
Jul 30 17:01:04.196604 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.196582    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"]
Jul 30 17:01:04.196738 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.196691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.199704 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.199676    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 30 17:01:04.199829 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.199736    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 30 17:01:04.199829 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.199771    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 17:01:04.199975 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.199960    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 17:01:04.200020 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.200008    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-l9f6w\""
Jul 30 17:01:04.205603 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.205584    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 30 17:01:04.212710 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.212689    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-ssf4q"]
Jul 30 17:01:04.212884 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.212862    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"]
Jul 30 17:01:04.213021 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.212747    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:04.215319 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.215302    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 17:01:04.215319 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.215312    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 30 17:01:04.215540 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.215528    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 17:01:04.216892 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.216879    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r9g9b\""
Jul 30 17:01:04.216962 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.216947    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 30 17:01:04.276829 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.276782    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"]
Jul 30 17:01:04.296618 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.296602    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9bcb675bf-2m6c4"]
Jul 30 17:01:04.296738 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.296721    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"
Jul 30 17:01:04.299427 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.299411    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:01:04.299505 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.299415    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 30 17:01:04.299575 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.299516    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 30 17:01:04.299683 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.299666    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qg6nk\""
Jul 30 17:01:04.299736 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.299720    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 30 17:01:04.312917 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.312892    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e5aec98-ff5b-433e-a248-e4a03acb903a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.312917 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.312917    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e5aec98-ff5b-433e-a248-e4a03acb903a-serving-cert\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.313050 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.312949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsn62\" (UniqueName: \"kubernetes.io/projected/5e5aec98-ff5b-433e-a248-e4a03acb903a-kube-api-access-bsn62\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.313050 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.313006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0399577e-b99f-4403-a296-04f3e4609d34-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:04.313050 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.313030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dfcj\" (UniqueName: \"kubernetes.io/projected/0399577e-b99f-4403-a296-04f3e4609d34-kube-api-access-4dfcj\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:04.313199 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.313094    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5e5aec98-ff5b-433e-a248-e4a03acb903a-snapshots\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.313199 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.313144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e5aec98-ff5b-433e-a248-e4a03acb903a-tmp\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.313294 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.313194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:04.313294 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.313224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e5aec98-ff5b-433e-a248-e4a03acb903a-service-ca-bundle\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.320224 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.320201    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"]
Jul 30 17:01:04.320224 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.320227    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9bcb675bf-2m6c4"]
Jul 30 17:01:04.320331 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.320243    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-z565h"]
Jul 30 17:01:04.320331 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.320302    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.322766 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.322749    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 30 17:01:04.322852 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.322801    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 30 17:01:04.322909 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.322868    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xsshl\""
Jul 30 17:01:04.323023 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.323008    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 30 17:01:04.323126 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.323111    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 30 17:01:04.323212 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.323197    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 17:01:04.323273 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.323233    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 17:01:04.342862 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.342842    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-z565h"
Jul 30 17:01:04.342934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.342844    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-z565h"]
Jul 30 17:01:04.345242 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.345228    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-r6wps\""
Jul 30 17:01:04.372046 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.372025    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zqd88"]
Jul 30 17:01:04.389316 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.389290    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-zjlzr"]
Jul 30 17:01:04.389459 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.389444    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zqd88"
Jul 30 17:01:04.393009 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.392987    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4btl4\""
Jul 30 17:01:04.393337 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.393320    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 30 17:01:04.393459 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.393320    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:01:04.405675 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.405650    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.405675 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.405663    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"]
Jul 30 17:01:04.407894 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.407880    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 30 17:01:04.408173 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.408159    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:01:04.408380 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.408364    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 30 17:01:04.408449 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.408393    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 30 17:01:04.408507 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.408450    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gnsff\""
Jul 30 17:01:04.413252 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.413234    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 30 17:01:04.413514 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.413499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0399577e-b99f-4403-a296-04f3e4609d34-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:04.413579 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.413524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dfcj\" (UniqueName: \"kubernetes.io/projected/0399577e-b99f-4403-a296-04f3e4609d34-kube-api-access-4dfcj\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:04.413579 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.413543    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5e5aec98-ff5b-433e-a248-e4a03acb903a-snapshots\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.413694 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.413678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e5aec98-ff5b-433e-a248-e4a03acb903a-tmp\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.413751 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.413736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:04.413832 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.413762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e5aec98-ff5b-433e-a248-e4a03acb903a-service-ca-bundle\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.413832 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.413786    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e39baa-3777-40c0-a8bf-9ee9ac9f2800-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx\" (UID: \"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"
Jul 30 17:01:04.413952 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:04.413887    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:04.413952 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:04.413937    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls podName:0399577e-b99f-4403-a296-04f3e4609d34 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:04.913920933 +0000 UTC m=+41.643533409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-s5c9f" (UID: "0399577e-b99f-4403-a296-04f3e4609d34") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:04.414106 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.414086    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e5aec98-ff5b-433e-a248-e4a03acb903a-tmp\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.414183 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.414143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmlfq\" (UniqueName: \"kubernetes.io/projected/a5e39baa-3777-40c0-a8bf-9ee9ac9f2800-kube-api-access-dmlfq\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx\" (UID: \"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"
Jul 30 17:01:04.414232 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.414172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5e5aec98-ff5b-433e-a248-e4a03acb903a-snapshots\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.414267 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.414232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e5aec98-ff5b-433e-a248-e4a03acb903a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.414316 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.414270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e5aec98-ff5b-433e-a248-e4a03acb903a-serving-cert\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.414381 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.414322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn62\" (UniqueName: \"kubernetes.io/projected/5e5aec98-ff5b-433e-a248-e4a03acb903a-kube-api-access-bsn62\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.414381 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.414337    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e5aec98-ff5b-433e-a248-e4a03acb903a-service-ca-bundle\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.414381 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.414371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5e39baa-3777-40c0-a8bf-9ee9ac9f2800-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx\" (UID: \"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"
Jul 30 17:01:04.414524 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.414419    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0399577e-b99f-4403-a296-04f3e4609d34-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:04.414962 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.414941    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e5aec98-ff5b-433e-a248-e4a03acb903a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.415585 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.415565    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zqd88"]
Jul 30 17:01:04.415650 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.415602    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"]
Jul 30 17:01:04.415650 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.415622    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-zjlzr"]
Jul 30 17:01:04.415650 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.415623    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"
Jul 30 17:01:04.417830 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.417815    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zbjb2\""
Jul 30 17:01:04.417896 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.417817    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 30 17:01:04.418668 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.418544    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e5aec98-ff5b-433e-a248-e4a03acb903a-serving-cert\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.418668 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.418603    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 30 17:01:04.418668 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.418612    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 30 17:01:04.418668 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.418626    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:01:04.422277 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.422260    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dfcj\" (UniqueName: \"kubernetes.io/projected/0399577e-b99f-4403-a296-04f3e4609d34-kube-api-access-4dfcj\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:04.425197 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.425178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsn62\" (UniqueName: \"kubernetes.io/projected/5e5aec98-ff5b-433e-a248-e4a03acb903a-kube-api-access-bsn62\") pod \"insights-operator-5885fdb759-ssf4q\" (UID: \"5e5aec98-ff5b-433e-a248-e4a03acb903a\") " pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.474447 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.474423    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"]
Jul 30 17:01:04.486417 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.486399    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:04.487492 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.487465    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"]
Jul 30 17:01:04.488939 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.488922    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ssg4v\""
Jul 30 17:01:04.489035 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.488945    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 30 17:01:04.489107 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.489033    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:01:04.489229 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.489215    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 30 17:01:04.507083 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.507061    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-ssf4q"
Jul 30 17:01:04.514891 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.514694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kdx6\" (UniqueName: \"kubernetes.io/projected/4d2ca850-8032-4937-ad30-812d16c4b565-kube-api-access-7kdx6\") pod \"volume-data-source-validator-549c6d54cf-zqd88\" (UID: \"4d2ca850-8032-4937-ad30-812d16c4b565\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zqd88"
Jul 30 17:01:04.514891 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.514737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e39baa-3777-40c0-a8bf-9ee9ac9f2800-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx\" (UID: \"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"
Jul 30 17:01:04.514891 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.514772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a86ed67-ee6d-4f89-86df-d2b98c92e6d0-config\") pod \"service-ca-operator-5d6c75f84f-bpdck\" (UID: \"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"
Jul 30 17:01:04.514891 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.514799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a86ed67-ee6d-4f89-86df-d2b98c92e6d0-serving-cert\") pod \"service-ca-operator-5d6c75f84f-bpdck\" (UID: \"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"
Jul 30 17:01:04.514891 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.514824    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp7df\" (UniqueName: \"kubernetes.io/projected/1a86ed67-ee6d-4f89-86df-d2b98c92e6d0-kube-api-access-gp7df\") pod \"service-ca-operator-5d6c75f84f-bpdck\" (UID: \"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"
Jul 30 17:01:04.514891 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.514862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-stats-auth\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.515182 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.514895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.515182 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.514985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-default-certificate\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.515182 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.515008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-config\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.515182 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.515037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.515182 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.515068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5e39baa-3777-40c0-a8bf-9ee9ac9f2800-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx\" (UID: \"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"
Jul 30 17:01:04.515182 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.515097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjvx6\" (UniqueName: \"kubernetes.io/projected/5178ee7e-3787-4167-9ed8-b6f255fc4190-kube-api-access-rjvx6\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.515182 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.515124    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrpld\" (UniqueName: \"kubernetes.io/projected/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-kube-api-access-zrpld\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.515182 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.515150    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-trusted-ca\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.515182 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.515175    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2smkf\" (UniqueName: \"kubernetes.io/projected/7868b999-9c89-456d-afa9-8e418549dfe9-kube-api-access-2smkf\") pod \"network-check-source-7d88cb55d8-z565h\" (UID: \"7868b999-9c89-456d-afa9-8e418549dfe9\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-z565h"
Jul 30 17:01:04.515533 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.515292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmlfq\" (UniqueName: \"kubernetes.io/projected/a5e39baa-3777-40c0-a8bf-9ee9ac9f2800-kube-api-access-dmlfq\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx\" (UID: \"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"
Jul 30 17:01:04.515533 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.515328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-serving-cert\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.515630 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.515586    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a5e39baa-3777-40c0-a8bf-9ee9ac9f2800-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx\" (UID: \"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"
Jul 30 17:01:04.517571 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.517529    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e39baa-3777-40c0-a8bf-9ee9ac9f2800-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx\" (UID: \"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"
Jul 30 17:01:04.524842 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.524815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmlfq\" (UniqueName: \"kubernetes.io/projected/a5e39baa-3777-40c0-a8bf-9ee9ac9f2800-kube-api-access-dmlfq\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx\" (UID: \"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"
Jul 30 17:01:04.605469 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.605250    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"
Jul 30 17:01:04.615766 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.615744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kdx6\" (UniqueName: \"kubernetes.io/projected/4d2ca850-8032-4937-ad30-812d16c4b565-kube-api-access-7kdx6\") pod \"volume-data-source-validator-549c6d54cf-zqd88\" (UID: \"4d2ca850-8032-4937-ad30-812d16c4b565\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zqd88"
Jul 30 17:01:04.615874 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.615778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a86ed67-ee6d-4f89-86df-d2b98c92e6d0-config\") pod \"service-ca-operator-5d6c75f84f-bpdck\" (UID: \"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"
Jul 30 17:01:04.615874 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.615796    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a86ed67-ee6d-4f89-86df-d2b98c92e6d0-serving-cert\") pod \"service-ca-operator-5d6c75f84f-bpdck\" (UID: \"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"
Jul 30 17:01:04.615874 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.615811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp7df\" (UniqueName: \"kubernetes.io/projected/1a86ed67-ee6d-4f89-86df-d2b98c92e6d0-kube-api-access-gp7df\") pod \"service-ca-operator-5d6c75f84f-bpdck\" (UID: \"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"
Jul 30 17:01:04.615874 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.615842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-stats-auth\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.616060 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.615876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.616060 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.615914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-grg64\" (UID: \"bf948955-5cf4-4fe2-9204-5b5e5113c3cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:04.616060 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.615970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-default-certificate\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.616060 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.615990    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-config\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.616060 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.616009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.616060 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.616035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjvx6\" (UniqueName: \"kubernetes.io/projected/5178ee7e-3787-4167-9ed8-b6f255fc4190-kube-api-access-rjvx6\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.616060 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.616058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrpld\" (UniqueName: \"kubernetes.io/projected/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-kube-api-access-zrpld\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.616366 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.616086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-trusted-ca\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.616366 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.616115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2smkf\" (UniqueName: \"kubernetes.io/projected/7868b999-9c89-456d-afa9-8e418549dfe9-kube-api-access-2smkf\") pod \"network-check-source-7d88cb55d8-z565h\" (UID: \"7868b999-9c89-456d-afa9-8e418549dfe9\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-z565h"
Jul 30 17:01:04.616366 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.616162    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvmrw\" (UniqueName: \"kubernetes.io/projected/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-kube-api-access-tvmrw\") pod \"cluster-samples-operator-6748489656-grg64\" (UID: \"bf948955-5cf4-4fe2-9204-5b5e5113c3cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:04.616366 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:04.616195    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:05.116174043 +0000 UTC m=+41.845786535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : configmap references non-existent config key: service-ca.crt
Jul 30 17:01:04.616597 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.616453    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a86ed67-ee6d-4f89-86df-d2b98c92e6d0-config\") pod \"service-ca-operator-5d6c75f84f-bpdck\" (UID: \"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"
Jul 30 17:01:04.616597 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.616485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-serving-cert\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.616597 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:04.616591    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 17:01:04.616754 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:04.616646    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:05.11662883 +0000 UTC m=+41.846241310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : secret "router-metrics-certs-default" not found
Jul 30 17:01:04.617422 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.617337    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-config\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.617422 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.617368    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-trusted-ca\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.618648 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.618605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a86ed67-ee6d-4f89-86df-d2b98c92e6d0-serving-cert\") pod \"service-ca-operator-5d6c75f84f-bpdck\" (UID: \"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"
Jul 30 17:01:04.618795 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.618779    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-serving-cert\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.619290 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.619269    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-default-certificate\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.619361 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.619291    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-stats-auth\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.625142 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.624960    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kdx6\" (UniqueName: \"kubernetes.io/projected/4d2ca850-8032-4937-ad30-812d16c4b565-kube-api-access-7kdx6\") pod \"volume-data-source-validator-549c6d54cf-zqd88\" (UID: \"4d2ca850-8032-4937-ad30-812d16c4b565\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zqd88"
Jul 30 17:01:04.625142 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.624970    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp7df\" (UniqueName: \"kubernetes.io/projected/1a86ed67-ee6d-4f89-86df-d2b98c92e6d0-kube-api-access-gp7df\") pod \"service-ca-operator-5d6c75f84f-bpdck\" (UID: \"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"
Jul 30 17:01:04.625653 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.625631    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrpld\" (UniqueName: \"kubernetes.io/projected/f7f639b3-092f-48bd-81a8-86a3dd28ba5f-kube-api-access-zrpld\") pod \"console-operator-584dcb6b54-zjlzr\" (UID: \"f7f639b3-092f-48bd-81a8-86a3dd28ba5f\") " pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.625807 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.625790    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2smkf\" (UniqueName: \"kubernetes.io/projected/7868b999-9c89-456d-afa9-8e418549dfe9-kube-api-access-2smkf\") pod \"network-check-source-7d88cb55d8-z565h\" (UID: \"7868b999-9c89-456d-afa9-8e418549dfe9\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-z565h"
Jul 30 17:01:04.625976 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.625959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjvx6\" (UniqueName: \"kubernetes.io/projected/5178ee7e-3787-4167-9ed8-b6f255fc4190-kube-api-access-rjvx6\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:04.639534 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.639513    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-ssf4q"]
Jul 30 17:01:04.650409 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.650391    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-z565h"
Jul 30 17:01:04.652415 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:04.652395    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5aec98_ff5b_433e_a248_e4a03acb903a.slice/crio-ad4cefe52e0b4f2ba22580e3ee87c6353180a0013b59a9871d3e3afbcb9c12bb WatchSource:0}: Error finding container ad4cefe52e0b4f2ba22580e3ee87c6353180a0013b59a9871d3e3afbcb9c12bb: Status 404 returned error can't find the container with id ad4cefe52e0b4f2ba22580e3ee87c6353180a0013b59a9871d3e3afbcb9c12bb
Jul 30 17:01:04.699055 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.699029    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zqd88"
Jul 30 17:01:04.715679 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.715656    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:04.717036 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.716955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvmrw\" (UniqueName: \"kubernetes.io/projected/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-kube-api-access-tvmrw\") pod \"cluster-samples-operator-6748489656-grg64\" (UID: \"bf948955-5cf4-4fe2-9204-5b5e5113c3cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:04.717282 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.717256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-grg64\" (UID: \"bf948955-5cf4-4fe2-9204-5b5e5113c3cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:04.717471 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:04.717387    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 17:01:04.717471 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:04.717444    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls podName:bf948955-5cf4-4fe2-9204-5b5e5113c3cd nodeName:}" failed. No retries permitted until 2026-07-30 17:01:05.217425219 +0000 UTC m=+41.947037696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls") pod "cluster-samples-operator-6748489656-grg64" (UID: "bf948955-5cf4-4fe2-9204-5b5e5113c3cd") : secret "samples-operator-tls" not found
Jul 30 17:01:04.728879 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.727890    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvmrw\" (UniqueName: \"kubernetes.io/projected/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-kube-api-access-tvmrw\") pod \"cluster-samples-operator-6748489656-grg64\" (UID: \"bf948955-5cf4-4fe2-9204-5b5e5113c3cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:04.737370 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.737176    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"
Jul 30 17:01:04.786376 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.786276    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx"]
Jul 30 17:01:04.842440 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.841922    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-z565h"]
Jul 30 17:01:04.844260 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:04.844227    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7868b999_9c89_456d_afa9_8e418549dfe9.slice/crio-20f3c346e1a4b13f4c96c4b02a8f8c6637be9054584e162e912e3804c6128903 WatchSource:0}: Error finding container 20f3c346e1a4b13f4c96c4b02a8f8c6637be9054584e162e912e3804c6128903: Status 404 returned error can't find the container with id 20f3c346e1a4b13f4c96c4b02a8f8c6637be9054584e162e912e3804c6128903
Jul 30 17:01:04.889910 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.889883    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zqd88"]
Jul 30 17:01:04.892725 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:04.892700    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2ca850_8032_4937_ad30_812d16c4b565.slice/crio-9bc5951dd8c64a3310288879bdae447975aa4b7b07a2a8898854d8ce16dafee8 WatchSource:0}: Error finding container 9bc5951dd8c64a3310288879bdae447975aa4b7b07a2a8898854d8ce16dafee8: Status 404 returned error can't find the container with id 9bc5951dd8c64a3310288879bdae447975aa4b7b07a2a8898854d8ce16dafee8
Jul 30 17:01:04.920542 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.920518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:04.920672 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:04.920655    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:04.920717 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:04.920708    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls podName:0399577e-b99f-4403-a296-04f3e4609d34 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:05.920694001 +0000 UTC m=+42.650306479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-s5c9f" (UID: "0399577e-b99f-4403-a296-04f3e4609d34") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:04.985740 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.985701    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx" event={"ID":"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800","Type":"ContainerStarted","Data":"f081287a05134373bd810e3d0a6207d82b4c31723b6e841993e09cd55b7545a8"}
Jul 30 17:01:04.988723 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.987014    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-ssf4q" event={"ID":"5e5aec98-ff5b-433e-a248-e4a03acb903a","Type":"ContainerStarted","Data":"ad4cefe52e0b4f2ba22580e3ee87c6353180a0013b59a9871d3e3afbcb9c12bb"}
Jul 30 17:01:04.988723 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.988402    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zqd88" event={"ID":"4d2ca850-8032-4937-ad30-812d16c4b565","Type":"ContainerStarted","Data":"9bc5951dd8c64a3310288879bdae447975aa4b7b07a2a8898854d8ce16dafee8"}
Jul 30 17:01:04.989966 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:04.989943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-z565h" event={"ID":"7868b999-9c89-456d-afa9-8e418549dfe9","Type":"ContainerStarted","Data":"20f3c346e1a4b13f4c96c4b02a8f8c6637be9054584e162e912e3804c6128903"}
Jul 30 17:01:05.110726 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:05.110604    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck"]
Jul 30 17:01:05.113781 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:05.113753    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a86ed67_ee6d_4f89_86df_d2b98c92e6d0.slice/crio-c75ebc6499fa92516a00373a9bd7179acfb6ef5e0147b39ca4aee67cb2036e11 WatchSource:0}: Error finding container c75ebc6499fa92516a00373a9bd7179acfb6ef5e0147b39ca4aee67cb2036e11: Status 404 returned error can't find the container with id c75ebc6499fa92516a00373a9bd7179acfb6ef5e0147b39ca4aee67cb2036e11
Jul 30 17:01:05.114105 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:05.114082    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-zjlzr"]
Jul 30 17:01:05.117272 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:05.117248    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f639b3_092f_48bd_81a8_86a3dd28ba5f.slice/crio-2fe13d4c7900abc741dcb3b1ab0f080c1617598a602ebea0fbcc037a8691f012 WatchSource:0}: Error finding container 2fe13d4c7900abc741dcb3b1ab0f080c1617598a602ebea0fbcc037a8691f012: Status 404 returned error can't find the container with id 2fe13d4c7900abc741dcb3b1ab0f080c1617598a602ebea0fbcc037a8691f012
Jul 30 17:01:05.122368 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:05.122349    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:05.122453 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:05.122441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:05.122518 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:05.122506    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:06.122488427 +0000 UTC m=+42.852100902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : configmap references non-existent config key: service-ca.crt
Jul 30 17:01:05.122616 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:05.122599    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 17:01:05.122663 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:05.122652    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:06.122638545 +0000 UTC m=+42.852251023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : secret "router-metrics-certs-default" not found
Jul 30 17:01:05.223463 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:05.223428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-grg64\" (UID: \"bf948955-5cf4-4fe2-9204-5b5e5113c3cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:05.223612 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:05.223596    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 17:01:05.223688 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:05.223677    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls podName:bf948955-5cf4-4fe2-9204-5b5e5113c3cd nodeName:}" failed. No retries permitted until 2026-07-30 17:01:06.223659402 +0000 UTC m=+42.953271878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls") pod "cluster-samples-operator-6748489656-grg64" (UID: "bf948955-5cf4-4fe2-9204-5b5e5113c3cd") : secret "samples-operator-tls" not found
Jul 30 17:01:05.930303 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:05.930266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:05.930476 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:05.930416    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:05.930571 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:05.930478    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls podName:0399577e-b99f-4403-a296-04f3e4609d34 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:07.930460679 +0000 UTC m=+44.660073155 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-s5c9f" (UID: "0399577e-b99f-4403-a296-04f3e4609d34") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:05.994502 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:05.994418    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck" event={"ID":"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0","Type":"ContainerStarted","Data":"c75ebc6499fa92516a00373a9bd7179acfb6ef5e0147b39ca4aee67cb2036e11"}
Jul 30 17:01:05.995839 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:05.995796    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr" event={"ID":"f7f639b3-092f-48bd-81a8-86a3dd28ba5f","Type":"ContainerStarted","Data":"2fe13d4c7900abc741dcb3b1ab0f080c1617598a602ebea0fbcc037a8691f012"}
Jul 30 17:01:06.131837 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:06.131800    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:06.131998 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:06.131899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:06.132067 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:06.132056    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 17:01:06.132148 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:06.132124    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:08.132101754 +0000 UTC m=+44.861714236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : secret "router-metrics-certs-default" not found
Jul 30 17:01:06.132277 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:06.132247    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:08.132227885 +0000 UTC m=+44.861840363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : configmap references non-existent config key: service-ca.crt
Jul 30 17:01:06.232403 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:06.232366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-grg64\" (UID: \"bf948955-5cf4-4fe2-9204-5b5e5113c3cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:06.232630 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:06.232615    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 17:01:06.232692 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:06.232681    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls podName:bf948955-5cf4-4fe2-9204-5b5e5113c3cd nodeName:}" failed. No retries permitted until 2026-07-30 17:01:08.232662421 +0000 UTC m=+44.962274910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls") pod "cluster-samples-operator-6748489656-grg64" (UID: "bf948955-5cf4-4fe2-9204-5b5e5113c3cd") : secret "samples-operator-tls" not found
Jul 30 17:01:06.938470 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:06.938434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:01:06.938665 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:06.938521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:01:06.938665 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:06.938656    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:01:06.938745 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:06.938678    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588d4655-sz8xg: secret "image-registry-tls" not found
Jul 30 17:01:06.938745 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:06.938683    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:01:06.938745 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:06.938731    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls podName:fac44fd1-35de-46a1-b7b0-7689ec6078cc nodeName:}" failed. No retries permitted until 2026-07-30 17:01:14.938716319 +0000 UTC m=+51.668328795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls") pod "image-registry-588d4655-sz8xg" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc") : secret "image-registry-tls" not found
Jul 30 17:01:06.938885 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:06.938748    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls podName:c8189d07-aacf-4e6e-9d50-01259f44f2b4 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:14.938739254 +0000 UTC m=+51.668351730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls") pod "dns-default-jpxpz" (UID: "c8189d07-aacf-4e6e-9d50-01259f44f2b4") : secret "dns-default-metrics-tls" not found
Jul 30 17:01:07.946391 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:07.946285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:07.946873 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:07.946441    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:07.946873 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:07.946507    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls podName:0399577e-b99f-4403-a296-04f3e4609d34 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:11.946488843 +0000 UTC m=+48.676101322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-s5c9f" (UID: "0399577e-b99f-4403-a296-04f3e4609d34") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:08.148356 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:08.148327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:08.148494 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:08.148391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:08.148564 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:08.148495    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 17:01:08.148564 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:08.148494    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:12.148475947 +0000 UTC m=+48.878088442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : configmap references non-existent config key: service-ca.crt
Jul 30 17:01:08.148564 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:08.148533    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:12.148522867 +0000 UTC m=+48.878135342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : secret "router-metrics-certs-default" not found
Jul 30 17:01:08.248959 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:08.248930    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-grg64\" (UID: \"bf948955-5cf4-4fe2-9204-5b5e5113c3cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:08.249076 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:08.249061    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 17:01:08.249122 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:08.249115    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls podName:bf948955-5cf4-4fe2-9204-5b5e5113c3cd nodeName:}" failed. No retries permitted until 2026-07-30 17:01:12.24910359 +0000 UTC m=+48.978716066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls") pod "cluster-samples-operator-6748489656-grg64" (UID: "bf948955-5cf4-4fe2-9204-5b5e5113c3cd") : secret "samples-operator-tls" not found
Jul 30 17:01:11.980673 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:11.980635    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:11.981147 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:11.980765    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:11.981147 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:11.980830    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls podName:0399577e-b99f-4403-a296-04f3e4609d34 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:19.980809589 +0000 UTC m=+56.710422070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-s5c9f" (UID: "0399577e-b99f-4403-a296-04f3e4609d34") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:12.014758 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.014725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-ssf4q" event={"ID":"5e5aec98-ff5b-433e-a248-e4a03acb903a","Type":"ContainerStarted","Data":"fdb23cebe89099e60ca0bab9250543a749e4cfc73dac2e5558b273ef632c0384"}
Jul 30 17:01:12.016825 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.016796    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck" event={"ID":"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0","Type":"ContainerStarted","Data":"00075a304e53946e0092491231e86add358714c01c941b598af21ae257c92eb3"}
Jul 30 17:01:12.019256 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.019234    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/0.log"
Jul 30 17:01:12.019399 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.019271    2561 generic.go:356] "Generic (PLEG): container finished" podID="f7f639b3-092f-48bd-81a8-86a3dd28ba5f" containerID="8ff1bea974e9ccb58a935ac01a0047dfcba9f89417e6ca1853f12d860e9d56af" exitCode=255
Jul 30 17:01:12.019399 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.019388    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr" event={"ID":"f7f639b3-092f-48bd-81a8-86a3dd28ba5f","Type":"ContainerDied","Data":"8ff1bea974e9ccb58a935ac01a0047dfcba9f89417e6ca1853f12d860e9d56af"}
Jul 30 17:01:12.019791 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.019672    2561 scope.go:117] "RemoveContainer" containerID="8ff1bea974e9ccb58a935ac01a0047dfcba9f89417e6ca1853f12d860e9d56af"
Jul 30 17:01:12.021686 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.021665    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zqd88" event={"ID":"4d2ca850-8032-4937-ad30-812d16c4b565","Type":"ContainerStarted","Data":"d8b5cef963ab9d91c4a4e3bf9209e2876c287f23a5f311b6d235db1238288af4"}
Jul 30 17:01:12.023389 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.023337    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-z565h" event={"ID":"7868b999-9c89-456d-afa9-8e418549dfe9","Type":"ContainerStarted","Data":"35edbc048a87c32039904be0736edbea7f89ac76ed2f28c9eb0db05791fba655"}
Jul 30 17:01:12.024942 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.024921    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx" event={"ID":"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800","Type":"ContainerStarted","Data":"46e01c7f26fae7216ce74916c7dabad4031914132d000d37145ff512e75d8a85"}
Jul 30 17:01:12.031725 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.031678    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-ssf4q" podStartSLOduration=1.61989535 podStartE2EDuration="8.031661408s" totalImagesPullingTime="6.411766058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:12.030378111 +0000 UTC m=+48.759990632" watchObservedRunningTime="2026-07-30 17:01:12.031661408 +0000 UTC m=+48.761273908"
Jul 30 17:01:12.045987 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.045944    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx" podStartSLOduration=1.684904762 podStartE2EDuration="8.045928106s" totalImagesPullingTime="6.361023344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:12.044878826 +0000 UTC m=+48.774491325" watchObservedRunningTime="2026-07-30 17:01:12.045928106 +0000 UTC m=+48.775540605"
Jul 30 17:01:12.085495 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.085448    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-z565h" podStartSLOduration=1.778976343 podStartE2EDuration="8.085430837s" totalImagesPullingTime="6.306454494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:12.085364267 +0000 UTC m=+48.814976764" watchObservedRunningTime="2026-07-30 17:01:12.085430837 +0000 UTC m=+48.815043340"
Jul 30 17:01:12.119210 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.119163    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zqd88" podStartSLOduration=1.860961198 podStartE2EDuration="8.119146019s" totalImagesPullingTime="6.258184821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:12.103006168 +0000 UTC m=+48.832618692" watchObservedRunningTime="2026-07-30 17:01:12.119146019 +0000 UTC m=+48.848758518"
Jul 30 17:01:12.119317 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.119258    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck" podStartSLOduration=2.07707886 podStartE2EDuration="8.119249595s" totalImagesPullingTime="6.042170735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:12.117355832 +0000 UTC m=+48.846968331" watchObservedRunningTime="2026-07-30 17:01:12.119249595 +0000 UTC m=+48.848862094"
Jul 30 17:01:12.184046 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.184012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:12.184162 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.184095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:12.184240 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:12.184218    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 17:01:12.184350 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:12.184268    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:20.184255084 +0000 UTC m=+56.913867560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : secret "router-metrics-certs-default" not found
Jul 30 17:01:12.184563 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:12.184526    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:20.184515612 +0000 UTC m=+56.914128088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : configmap references non-existent config key: service-ca.crt
Jul 30 17:01:12.285070 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:12.285045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-grg64\" (UID: \"bf948955-5cf4-4fe2-9204-5b5e5113c3cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:12.285230 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:12.285211    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 17:01:12.285291 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:12.285284    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls podName:bf948955-5cf4-4fe2-9204-5b5e5113c3cd nodeName:}" failed. No retries permitted until 2026-07-30 17:01:20.285265549 +0000 UTC m=+57.014878026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls") pod "cluster-samples-operator-6748489656-grg64" (UID: "bf948955-5cf4-4fe2-9204-5b5e5113c3cd") : secret "samples-operator-tls" not found
Jul 30 17:01:13.034189 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.034163    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/1.log"
Jul 30 17:01:13.034668 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.034647    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/0.log"
Jul 30 17:01:13.034751 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.034692    2561 generic.go:356] "Generic (PLEG): container finished" podID="f7f639b3-092f-48bd-81a8-86a3dd28ba5f" containerID="714fb803e728d1d8af98e1ebe613e7b84bffc042531f668c027ee189c2472992" exitCode=255
Jul 30 17:01:13.034810 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.034786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr" event={"ID":"f7f639b3-092f-48bd-81a8-86a3dd28ba5f","Type":"ContainerDied","Data":"714fb803e728d1d8af98e1ebe613e7b84bffc042531f668c027ee189c2472992"}
Jul 30 17:01:13.034878 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.034865    2561 scope.go:117] "RemoveContainer" containerID="8ff1bea974e9ccb58a935ac01a0047dfcba9f89417e6ca1853f12d860e9d56af"
Jul 30 17:01:13.035133 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.035115    2561 scope.go:117] "RemoveContainer" containerID="714fb803e728d1d8af98e1ebe613e7b84bffc042531f668c027ee189c2472992"
Jul 30 17:01:13.035318 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:13.035297    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-zjlzr_openshift-console-operator(f7f639b3-092f-48bd-81a8-86a3dd28ba5f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr" podUID="f7f639b3-092f-48bd-81a8-86a3dd28ba5f"
Jul 30 17:01:13.468254 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.468217    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9jpt5"]
Jul 30 17:01:13.492856 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.492819    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9jpt5"]
Jul 30 17:01:13.493013 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.492918    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.495321 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.495297    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 17:01:13.495459 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.495369    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 17:01:13.495459 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.495380    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5tlpk\""
Jul 30 17:01:13.598000 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.597976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.598173 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.598024    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-crio-socket\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.598219 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.598174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.598271 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.598226    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srrbh\" (UniqueName: \"kubernetes.io/projected/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-api-access-srrbh\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.598271 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.598252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-data-volume\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.699126 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.699098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.699260 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.699148    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srrbh\" (UniqueName: \"kubernetes.io/projected/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-api-access-srrbh\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.699260 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.699170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-data-volume\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.699392 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:13.699263    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:13.699392 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.699294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.699392 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:13.699331    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls podName:f9d1ef43-e1f0-4112-954b-bd0e771f0fee nodeName:}" failed. No retries permitted until 2026-07-30 17:01:14.199307889 +0000 UTC m=+50.928920379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jpt5" (UID: "f9d1ef43-e1f0-4112-954b-bd0e771f0fee") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:13.699392 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:13.699353    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 17:01:13.699629 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.699393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-crio-socket\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.699629 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:13.699411    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm podName:f9d1ef43-e1f0-4112-954b-bd0e771f0fee nodeName:}" failed. No retries permitted until 2026-07-30 17:01:14.199396185 +0000 UTC m=+50.929008683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9jpt5" (UID: "f9d1ef43-e1f0-4112-954b-bd0e771f0fee") : configmap "kube-rbac-proxy" not found
Jul 30 17:01:13.699629 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.699471    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-data-volume\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.699629 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.699609    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-crio-socket\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.712214 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.712191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srrbh\" (UniqueName: \"kubernetes.io/projected/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-api-access-srrbh\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:13.746725 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.746663    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq"]
Jul 30 17:01:13.756388 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.756371    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq"
Jul 30 17:01:13.759130 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.759108    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 30 17:01:13.759596 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.759570    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 30 17:01:13.759719 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.759572    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xkwx5\""
Jul 30 17:01:13.760939 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.760911    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq"]
Jul 30 17:01:13.799875 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.799846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntr9g\" (UniqueName: \"kubernetes.io/projected/1ca4429d-274f-4b69-8573-7a62e2b526b5-kube-api-access-ntr9g\") pod \"migrator-6865c9967-5k7vq\" (UID: \"1ca4429d-274f-4b69-8573-7a62e2b526b5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq"
Jul 30 17:01:13.901154 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.901122    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntr9g\" (UniqueName: \"kubernetes.io/projected/1ca4429d-274f-4b69-8573-7a62e2b526b5-kube-api-access-ntr9g\") pod \"migrator-6865c9967-5k7vq\" (UID: \"1ca4429d-274f-4b69-8573-7a62e2b526b5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq"
Jul 30 17:01:13.909348 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:13.909321    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntr9g\" (UniqueName: \"kubernetes.io/projected/1ca4429d-274f-4b69-8573-7a62e2b526b5-kube-api-access-ntr9g\") pod \"migrator-6865c9967-5k7vq\" (UID: \"1ca4429d-274f-4b69-8573-7a62e2b526b5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq"
Jul 30 17:01:14.039420 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.039355    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/1.log"
Jul 30 17:01:14.039762 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.039663    2561 scope.go:117] "RemoveContainer" containerID="714fb803e728d1d8af98e1ebe613e7b84bffc042531f668c027ee189c2472992"
Jul 30 17:01:14.039802 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:14.039786    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-zjlzr_openshift-console-operator(f7f639b3-092f-48bd-81a8-86a3dd28ba5f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr" podUID="f7f639b3-092f-48bd-81a8-86a3dd28ba5f"
Jul 30 17:01:14.068079 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.068053    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq"
Jul 30 17:01:14.203443 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.203412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:14.203592 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:14.203529    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 17:01:14.203592 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.203539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:14.203673 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:14.203656    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:14.203721 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:14.203708    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm podName:f9d1ef43-e1f0-4112-954b-bd0e771f0fee nodeName:}" failed. No retries permitted until 2026-07-30 17:01:15.203685516 +0000 UTC m=+51.933298014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9jpt5" (UID: "f9d1ef43-e1f0-4112-954b-bd0e771f0fee") : configmap "kube-rbac-proxy" not found
Jul 30 17:01:14.203773 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:14.203734    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls podName:f9d1ef43-e1f0-4112-954b-bd0e771f0fee nodeName:}" failed. No retries permitted until 2026-07-30 17:01:15.203724084 +0000 UTC m=+51.933336561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jpt5" (UID: "f9d1ef43-e1f0-4112-954b-bd0e771f0fee") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:14.215241 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.215215    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq"]
Jul 30 17:01:14.223099 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:14.223080    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca4429d_274f_4b69_8573_7a62e2b526b5.slice/crio-324741f7eab4088878eada3ecc0c385ec146e53213626bd76f6bbed855001001 WatchSource:0}: Error finding container 324741f7eab4088878eada3ecc0c385ec146e53213626bd76f6bbed855001001: Status 404 returned error can't find the container with id 324741f7eab4088878eada3ecc0c385ec146e53213626bd76f6bbed855001001
Jul 30 17:01:14.716036 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.716009    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:14.716180 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.716078    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:14.860496 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.860469    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w95np_0dccf377-bcac-4887-92eb-672c457457ad/dns-node-resolver/0.log"
Jul 30 17:01:14.912526 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.912496    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-v7jv8"]
Jul 30 17:01:14.926844 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.926817    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-v7jv8"]
Jul 30 17:01:14.926983 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.926928    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8"
Jul 30 17:01:14.929821 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.929636    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 30 17:01:14.931010 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.930584    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-drnln\""
Jul 30 17:01:14.931010 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.930598    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 30 17:01:14.931010 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.930584    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 30 17:01:14.931185 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:14.931140    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 30 17:01:15.011524 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.011461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29-signing-key\") pod \"service-ca-658d7b7c78-v7jv8\" (UID: \"b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29\") " pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8"
Jul 30 17:01:15.011524 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.011504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gbdt\" (UniqueName: \"kubernetes.io/projected/b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29-kube-api-access-2gbdt\") pod \"service-ca-658d7b7c78-v7jv8\" (UID: \"b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29\") " pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8"
Jul 30 17:01:15.011700 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.011640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29-signing-cabundle\") pod \"service-ca-658d7b7c78-v7jv8\" (UID: \"b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29\") " pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8"
Jul 30 17:01:15.011700 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.011690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:01:15.011807 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.011787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:01:15.011891 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:15.011804    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:01:15.011891 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:15.011889    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588d4655-sz8xg: secret "image-registry-tls" not found
Jul 30 17:01:15.012058 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:15.011965    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls podName:fac44fd1-35de-46a1-b7b0-7689ec6078cc nodeName:}" failed. No retries permitted until 2026-07-30 17:01:31.0119515 +0000 UTC m=+67.741563975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls") pod "image-registry-588d4655-sz8xg" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc") : secret "image-registry-tls" not found
Jul 30 17:01:15.012058 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:15.011861    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:01:15.012058 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:15.012054    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls podName:c8189d07-aacf-4e6e-9d50-01259f44f2b4 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:31.012041224 +0000 UTC m=+67.741653703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls") pod "dns-default-jpxpz" (UID: "c8189d07-aacf-4e6e-9d50-01259f44f2b4") : secret "dns-default-metrics-tls" not found
Jul 30 17:01:15.043981 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.043957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq" event={"ID":"1ca4429d-274f-4b69-8573-7a62e2b526b5","Type":"ContainerStarted","Data":"324741f7eab4088878eada3ecc0c385ec146e53213626bd76f6bbed855001001"}
Jul 30 17:01:15.044342 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.044262    2561 scope.go:117] "RemoveContainer" containerID="714fb803e728d1d8af98e1ebe613e7b84bffc042531f668c027ee189c2472992"
Jul 30 17:01:15.044440 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:15.044418    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-zjlzr_openshift-console-operator(f7f639b3-092f-48bd-81a8-86a3dd28ba5f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr" podUID="f7f639b3-092f-48bd-81a8-86a3dd28ba5f"
Jul 30 17:01:15.112358 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.112333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29-signing-key\") pod \"service-ca-658d7b7c78-v7jv8\" (UID: \"b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29\") " pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8"
Jul 30 17:01:15.112453 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.112365    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gbdt\" (UniqueName: \"kubernetes.io/projected/b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29-kube-api-access-2gbdt\") pod \"service-ca-658d7b7c78-v7jv8\" (UID: \"b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29\") " pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8"
Jul 30 17:01:15.112528 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.112485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29-signing-cabundle\") pod \"service-ca-658d7b7c78-v7jv8\" (UID: \"b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29\") " pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8"
Jul 30 17:01:15.113097 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.113074    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29-signing-cabundle\") pod \"service-ca-658d7b7c78-v7jv8\" (UID: \"b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29\") " pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8"
Jul 30 17:01:15.114886 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.114869    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29-signing-key\") pod \"service-ca-658d7b7c78-v7jv8\" (UID: \"b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29\") " pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8"
Jul 30 17:01:15.120654 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.120636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gbdt\" (UniqueName: \"kubernetes.io/projected/b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29-kube-api-access-2gbdt\") pod \"service-ca-658d7b7c78-v7jv8\" (UID: \"b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29\") " pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8"
Jul 30 17:01:15.213245 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.213214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:15.213386 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:15.213332    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 17:01:15.213386 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.213348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:15.213479 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:15.213399    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm podName:f9d1ef43-e1f0-4112-954b-bd0e771f0fee nodeName:}" failed. No retries permitted until 2026-07-30 17:01:17.213380496 +0000 UTC m=+53.942992979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9jpt5" (UID: "f9d1ef43-e1f0-4112-954b-bd0e771f0fee") : configmap "kube-rbac-proxy" not found
Jul 30 17:01:15.213479 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:15.213452    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:15.213579 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:15.213509    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls podName:f9d1ef43-e1f0-4112-954b-bd0e771f0fee nodeName:}" failed. No retries permitted until 2026-07-30 17:01:17.213497692 +0000 UTC m=+53.943110168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jpt5" (UID: "f9d1ef43-e1f0-4112-954b-bd0e771f0fee") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:15.237785 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.237760    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8"
Jul 30 17:01:15.550752 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.550722    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-v7jv8"]
Jul 30 17:01:15.553633 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:15.553605    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ad0514_0fcd_4f2c_a95d_a0aa0fec4b29.slice/crio-8c7ca7db24f38f3060d428e6c5fb68f937cd5a8cfc1d7d9f16c2c2da449850c7 WatchSource:0}: Error finding container 8c7ca7db24f38f3060d428e6c5fb68f937cd5a8cfc1d7d9f16c2c2da449850c7: Status 404 returned error can't find the container with id 8c7ca7db24f38f3060d428e6c5fb68f937cd5a8cfc1d7d9f16c2c2da449850c7
Jul 30 17:01:15.660115 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:15.660092    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-98hsx_41d50b58-6804-479b-a731-a2e3e4d3b2cd/node-ca/0.log"
Jul 30 17:01:16.047936 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:16.047909    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq" event={"ID":"1ca4429d-274f-4b69-8573-7a62e2b526b5","Type":"ContainerStarted","Data":"f823e4892a3d4215998d92a09036229072e1d00235c72a6b5e6e8eee6d59ec7a"}
Jul 30 17:01:16.049317 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:16.049291    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8" event={"ID":"b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29","Type":"ContainerStarted","Data":"74b3747b03d96ec67f63be3f04196e363c9cedc6c130fbb7df2376d4ad25dc52"}
Jul 30 17:01:16.049400 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:16.049329    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8" event={"ID":"b5ad0514-0fcd-4f2c-a95d-a0aa0fec4b29","Type":"ContainerStarted","Data":"8c7ca7db24f38f3060d428e6c5fb68f937cd5a8cfc1d7d9f16c2c2da449850c7"}
Jul 30 17:01:16.070242 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:16.070204    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-v7jv8" podStartSLOduration=2.070189533 podStartE2EDuration="2.070189533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:16.069761289 +0000 UTC m=+52.799373788" watchObservedRunningTime="2026-07-30 17:01:16.070189533 +0000 UTC m=+52.799802030"
Jul 30 17:01:16.262301 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:16.262281    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jlf8x_d70dea2b-c5ea-403d-9811-a21ddfe1f30f/serve-healthcheck-canary/0.log"
Jul 30 17:01:17.055445 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:17.055410    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq" event={"ID":"1ca4429d-274f-4b69-8573-7a62e2b526b5","Type":"ContainerStarted","Data":"16a19b22aec81b5f6adbb732fc7b2a2af5a5b185f7429111ea81a4be76726d28"}
Jul 30 17:01:17.119149 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:17.119090    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-5k7vq" podStartSLOduration=2.511402724 podStartE2EDuration="4.11907116s" totalImagesPullingTime="1.607668436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:17.118098782 +0000 UTC m=+53.847711280" watchObservedRunningTime="2026-07-30 17:01:17.11907116 +0000 UTC m=+53.848683657"
Jul 30 17:01:17.233510 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:17.233474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:17.233701 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:17.233661    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:17.233855 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:17.233833    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:17.233922 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:17.233910    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls podName:f9d1ef43-e1f0-4112-954b-bd0e771f0fee nodeName:}" failed. No retries permitted until 2026-07-30 17:01:21.233891864 +0000 UTC m=+57.963504356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jpt5" (UID: "f9d1ef43-e1f0-4112-954b-bd0e771f0fee") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:17.234006 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:17.233988    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:20.054102 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:20.054070    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:20.054454 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:20.054177    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:20.054454 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:20.054231    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls podName:0399577e-b99f-4403-a296-04f3e4609d34 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:36.054213981 +0000 UTC m=+72.783826459 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-s5c9f" (UID: "0399577e-b99f-4403-a296-04f3e4609d34") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:01:20.255357 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:20.255330    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:20.255498 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:20.255400    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:20.255604 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:20.255494    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 17:01:20.255604 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:20.255507    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:36.255492089 +0000 UTC m=+72.985104565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : configmap references non-existent config key: service-ca.crt
Jul 30 17:01:20.255604 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:20.255576    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs podName:5178ee7e-3787-4167-9ed8-b6f255fc4190 nodeName:}" failed. No retries permitted until 2026-07-30 17:01:36.255534625 +0000 UTC m=+72.985147101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs") pod "router-default-9bcb675bf-2m6c4" (UID: "5178ee7e-3787-4167-9ed8-b6f255fc4190") : secret "router-metrics-certs-default" not found
Jul 30 17:01:20.356685 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:20.356622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-grg64\" (UID: \"bf948955-5cf4-4fe2-9204-5b5e5113c3cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:20.359042 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:20.359020    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf948955-5cf4-4fe2-9204-5b5e5113c3cd-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-grg64\" (UID: \"bf948955-5cf4-4fe2-9204-5b5e5113c3cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:20.395860 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:20.395841    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"
Jul 30 17:01:20.515881 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:20.515846    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64"]
Jul 30 17:01:21.067409 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:21.067361    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64" event={"ID":"bf948955-5cf4-4fe2-9204-5b5e5113c3cd","Type":"ContainerStarted","Data":"86e85916a04a121ecc35b7b1dac008aa3bcc50b56a999f6e3b7e4073c7493f4f"}
Jul 30 17:01:21.264584 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:21.264539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:21.264747 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:21.264661    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:21.264747 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:21.264714    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls podName:f9d1ef43-e1f0-4112-954b-bd0e771f0fee nodeName:}" failed. No retries permitted until 2026-07-30 17:01:29.264700891 +0000 UTC m=+65.994313368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9jpt5" (UID: "f9d1ef43-e1f0-4112-954b-bd0e771f0fee") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:01:23.079413 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:23.079369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64" event={"ID":"bf948955-5cf4-4fe2-9204-5b5e5113c3cd","Type":"ContainerStarted","Data":"c3346fbffc6c75a304dacb012e0976bbe6292d33623cbd7fd9c70ff5a2b306fd"}
Jul 30 17:01:23.079796 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:23.079464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64" event={"ID":"bf948955-5cf4-4fe2-9204-5b5e5113c3cd","Type":"ContainerStarted","Data":"83080f719f2338dccd0ecccf60ed0cb3bce02397a242c9b44f52388260b3c8bf"}
Jul 30 17:01:23.095211 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:23.095167    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-grg64" podStartSLOduration=17.382851626 podStartE2EDuration="19.095154121s" totalImagesPullingTime="1.712302495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:23.094361139 +0000 UTC m=+59.823973636" watchObservedRunningTime="2026-07-30 17:01:23.095154121 +0000 UTC m=+59.824766619"
Jul 30 17:01:24.964509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:24.964484    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf9jb"
Jul 30 17:01:28.795210 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:28.795184    2561 scope.go:117] "RemoveContainer" containerID="714fb803e728d1d8af98e1ebe613e7b84bffc042531f668c027ee189c2472992"
Jul 30 17:01:29.098582 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.098532    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:01:29.098885 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.098873    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/1.log"
Jul 30 17:01:29.098938 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.098901    2561 generic.go:356] "Generic (PLEG): container finished" podID="f7f639b3-092f-48bd-81a8-86a3dd28ba5f" containerID="d3a57393495af59f4b718b5206d1afd74555a6bb17995c26bb726685ae2ba828" exitCode=255
Jul 30 17:01:29.098973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.098946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr" event={"ID":"f7f639b3-092f-48bd-81a8-86a3dd28ba5f","Type":"ContainerDied","Data":"d3a57393495af59f4b718b5206d1afd74555a6bb17995c26bb726685ae2ba828"}
Jul 30 17:01:29.099009 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.098991    2561 scope.go:117] "RemoveContainer" containerID="714fb803e728d1d8af98e1ebe613e7b84bffc042531f668c027ee189c2472992"
Jul 30 17:01:29.099273 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.099246    2561 scope.go:117] "RemoveContainer" containerID="d3a57393495af59f4b718b5206d1afd74555a6bb17995c26bb726685ae2ba828"
Jul 30 17:01:29.099425 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:29.099408    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-zjlzr_openshift-console-operator(f7f639b3-092f-48bd-81a8-86a3dd28ba5f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr" podUID="f7f639b3-092f-48bd-81a8-86a3dd28ba5f"
Jul 30 17:01:29.330650 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.330625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:29.332796 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.332773    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9d1ef43-e1f0-4112-954b-bd0e771f0fee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9jpt5\" (UID: \"f9d1ef43-e1f0-4112-954b-bd0e771f0fee\") " pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:29.404351 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.404299    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5tlpk\""
Jul 30 17:01:29.412475 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.412458    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9jpt5"
Jul 30 17:01:29.531998 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.531970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:01:29.535429 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.535405    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 17:01:29.536248 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.536231    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9jpt5"]
Jul 30 17:01:29.538891 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:29.538872    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d1ef43_e1f0_4112_954b_bd0e771f0fee.slice/crio-f531654420053bbf16704755dba88edb795fe0acb47a1db5c94cb12ad8996ab6 WatchSource:0}: Error finding container f531654420053bbf16704755dba88edb795fe0acb47a1db5c94cb12ad8996ab6: Status 404 returned error can't find the container with id f531654420053bbf16704755dba88edb795fe0acb47a1db5c94cb12ad8996ab6
Jul 30 17:01:29.544769 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.544749    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e3bd573-f6fa-4ab5-8aff-d0c113a700ac-metrics-certs\") pod \"network-metrics-daemon-8h2br\" (UID: \"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac\") " pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:01:29.633306 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.633282    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:01:29.635957 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.635939    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 17:01:29.645864 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.645842    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ed19618-5096-494b-b51f-d80f84f2b7a9-original-pull-secret\") pod \"global-pull-secret-syncer-zsm4g\" (UID: \"9ed19618-5096-494b-b51f-d80f84f2b7a9\") " pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:01:29.734304 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.734280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qt7g\" (UniqueName: \"kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g\") pod \"network-check-target-59w8z\" (UID: \"b2e74fdd-1e27-4058-9fd2-c45fa2071573\") " pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:01:29.736502 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.736485    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qt7g\" (UniqueName: \"kubernetes.io/projected/b2e74fdd-1e27-4058-9fd2-c45fa2071573-kube-api-access-2qt7g\") pod \"network-check-target-59w8z\" (UID: \"b2e74fdd-1e27-4058-9fd2-c45fa2071573\") " pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:01:29.807639 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.807618    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zsm4g"
Jul 30 17:01:29.818162 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.818143    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqjnm\""
Jul 30 17:01:29.824598 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.824575    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8h2br"
Jul 30 17:01:29.910051 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.910029    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w7mtp\""
Jul 30 17:01:29.915855 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.915822    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:01:29.945476 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.945314    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zsm4g"]
Jul 30 17:01:29.947427 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:29.947403    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed19618_5096_494b_b51f_d80f84f2b7a9.slice/crio-495f7d5ede3c3d87bcf9507fb28b1bf2b20fadb1a1e879a0e7e7b614ba48004a WatchSource:0}: Error finding container 495f7d5ede3c3d87bcf9507fb28b1bf2b20fadb1a1e879a0e7e7b614ba48004a: Status 404 returned error can't find the container with id 495f7d5ede3c3d87bcf9507fb28b1bf2b20fadb1a1e879a0e7e7b614ba48004a
Jul 30 17:01:29.960087 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:29.960064    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8h2br"]
Jul 30 17:01:29.962718 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:29.962693    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3bd573_f6fa_4ab5_8aff_d0c113a700ac.slice/crio-46c60f12887092c1784ea3ec14ee5f0c352ce3677239790ea0216c7e378a2f0a WatchSource:0}: Error finding container 46c60f12887092c1784ea3ec14ee5f0c352ce3677239790ea0216c7e378a2f0a: Status 404 returned error can't find the container with id 46c60f12887092c1784ea3ec14ee5f0c352ce3677239790ea0216c7e378a2f0a
Jul 30 17:01:30.065964 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:30.065879    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-59w8z"]
Jul 30 17:01:30.070032 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:30.070011    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e74fdd_1e27_4058_9fd2_c45fa2071573.slice/crio-282a29e0f6ad5b833a444d06d7a1198d3984e4bea9ff794aecba907bd0969a07 WatchSource:0}: Error finding container 282a29e0f6ad5b833a444d06d7a1198d3984e4bea9ff794aecba907bd0969a07: Status 404 returned error can't find the container with id 282a29e0f6ad5b833a444d06d7a1198d3984e4bea9ff794aecba907bd0969a07
Jul 30 17:01:30.102852 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:30.102828    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-59w8z" event={"ID":"b2e74fdd-1e27-4058-9fd2-c45fa2071573","Type":"ContainerStarted","Data":"282a29e0f6ad5b833a444d06d7a1198d3984e4bea9ff794aecba907bd0969a07"}
Jul 30 17:01:30.104420 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:30.104401    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:01:30.105606 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:30.105575    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zsm4g" event={"ID":"9ed19618-5096-494b-b51f-d80f84f2b7a9","Type":"ContainerStarted","Data":"495f7d5ede3c3d87bcf9507fb28b1bf2b20fadb1a1e879a0e7e7b614ba48004a"}
Jul 30 17:01:30.106667 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:30.106649    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8h2br" event={"ID":"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac","Type":"ContainerStarted","Data":"46c60f12887092c1784ea3ec14ee5f0c352ce3677239790ea0216c7e378a2f0a"}
Jul 30 17:01:30.107648 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:30.107629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9jpt5" event={"ID":"f9d1ef43-e1f0-4112-954b-bd0e771f0fee","Type":"ContainerStarted","Data":"f531654420053bbf16704755dba88edb795fe0acb47a1db5c94cb12ad8996ab6"}
Jul 30 17:01:31.047924 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.047887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:01:31.048371 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.047952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:01:31.054974 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.054944    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8189d07-aacf-4e6e-9d50-01259f44f2b4-metrics-tls\") pod \"dns-default-jpxpz\" (UID: \"c8189d07-aacf-4e6e-9d50-01259f44f2b4\") " pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:01:31.056202 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.056161    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls\") pod \"image-registry-588d4655-sz8xg\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") " pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:01:31.114873 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.114842    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-59w8z" event={"ID":"b2e74fdd-1e27-4058-9fd2-c45fa2071573","Type":"ContainerStarted","Data":"15c9feb73e3eddf81f67cf3d8e13ce37074a86866f55e942a76a69fac8652be9"}
Jul 30 17:01:31.115593 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.115574    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:01:31.268612 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.268586    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nffnt\""
Jul 30 17:01:31.276847 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.276826    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72fd8\""
Jul 30 17:01:31.277056 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.277040    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:01:31.285113 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.284956    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:01:31.465605 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.463651    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-59w8z" podStartSLOduration=66.463630041 podStartE2EDuration="1m6.463630041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:31.134060309 +0000 UTC m=+67.863672809" watchObservedRunningTime="2026-07-30 17:01:31.463630041 +0000 UTC m=+68.193242519"
Jul 30 17:01:31.465605 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.465519    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588d4655-sz8xg"]
Jul 30 17:01:31.475452 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:31.475424    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac44fd1_35de_46a1_b7b0_7689ec6078cc.slice/crio-ef0e499bc254e16463a82c0d04250570937944e4a9ab87fcd6f8ca268a945805 WatchSource:0}: Error finding container ef0e499bc254e16463a82c0d04250570937944e4a9ab87fcd6f8ca268a945805: Status 404 returned error can't find the container with id ef0e499bc254e16463a82c0d04250570937944e4a9ab87fcd6f8ca268a945805
Jul 30 17:01:31.491596 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:31.491571    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jpxpz"]
Jul 30 17:01:31.495943 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:31.495919    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8189d07_aacf_4e6e_9d50_01259f44f2b4.slice/crio-a5c66c1895cf0238f916f54add0b7762d8caedc4fb7385cf33e56b26f82e6a77 WatchSource:0}: Error finding container a5c66c1895cf0238f916f54add0b7762d8caedc4fb7385cf33e56b26f82e6a77: Status 404 returned error can't find the container with id a5c66c1895cf0238f916f54add0b7762d8caedc4fb7385cf33e56b26f82e6a77
Jul 30 17:01:32.121931 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:32.121897    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jpxpz" event={"ID":"c8189d07-aacf-4e6e-9d50-01259f44f2b4","Type":"ContainerStarted","Data":"a5c66c1895cf0238f916f54add0b7762d8caedc4fb7385cf33e56b26f82e6a77"}
Jul 30 17:01:32.124102 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:32.124003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588d4655-sz8xg" event={"ID":"fac44fd1-35de-46a1-b7b0-7689ec6078cc","Type":"ContainerStarted","Data":"71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618"}
Jul 30 17:01:32.124102 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:32.124051    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588d4655-sz8xg" event={"ID":"fac44fd1-35de-46a1-b7b0-7689ec6078cc","Type":"ContainerStarted","Data":"ef0e499bc254e16463a82c0d04250570937944e4a9ab87fcd6f8ca268a945805"}
Jul 30 17:01:32.147282 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:32.147235    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-588d4655-sz8xg" podStartSLOduration=67.147220994 podStartE2EDuration="1m7.147220994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:32.146420633 +0000 UTC m=+68.876033161" watchObservedRunningTime="2026-07-30 17:01:32.147220994 +0000 UTC m=+68.876833492"
Jul 30 17:01:33.132409 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:33.131876    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8h2br" event={"ID":"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac","Type":"ContainerStarted","Data":"f49dd676d65afa3876ea15f7734ec40034fded274f683a9655e5f93492ab5aef"}
Jul 30 17:01:33.132409 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:33.131948    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8h2br" event={"ID":"6e3bd573-f6fa-4ab5-8aff-d0c113a700ac","Type":"ContainerStarted","Data":"175638d6ba4a36c174f07bffe48e55d60e08b96a42a433a48f56e3d1100a9b32"}
Jul 30 17:01:33.132409 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:33.132167    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:01:33.149045 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:33.149002    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8h2br" podStartSLOduration=66.718000643 podStartE2EDuration="1m9.148985231s" totalImagesPullingTime="2.430984588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:33.147457777 +0000 UTC m=+69.877070301" watchObservedRunningTime="2026-07-30 17:01:33.148985231 +0000 UTC m=+69.878597781"
Jul 30 17:01:34.715853 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:34.715818    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:34.716237 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:34.715887    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:34.716237 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:34.716230    2561 scope.go:117] "RemoveContainer" containerID="d3a57393495af59f4b718b5206d1afd74555a6bb17995c26bb726685ae2ba828"
Jul 30 17:01:34.716414 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:01:34.716394    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-zjlzr_openshift-console-operator(f7f639b3-092f-48bd-81a8-86a3dd28ba5f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr" podUID="f7f639b3-092f-48bd-81a8-86a3dd28ba5f"
Jul 30 17:01:36.089695 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:36.089657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:36.092388 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:36.092356    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0399577e-b99f-4403-a296-04f3e4609d34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-s5c9f\" (UID: \"0399577e-b99f-4403-a296-04f3e4609d34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:36.292366 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:36.292334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:36.292576 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:36.292450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:36.293085 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:36.293060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5178ee7e-3787-4167-9ed8-b6f255fc4190-service-ca-bundle\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:36.295186 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:36.295161    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5178ee7e-3787-4167-9ed8-b6f255fc4190-metrics-certs\") pod \"router-default-9bcb675bf-2m6c4\" (UID: \"5178ee7e-3787-4167-9ed8-b6f255fc4190\") " pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:36.324149 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:36.324125    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r9g9b\""
Jul 30 17:01:36.331590 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:36.331568    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"
Jul 30 17:01:36.431869 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:36.431839    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xsshl\""
Jul 30 17:01:36.439834 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:36.439803    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:37.909183 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:37.908954    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f"]
Jul 30 17:01:37.911792 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:37.911769    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0399577e_b99f_4403_a296_04f3e4609d34.slice/crio-7968d3f6e354171f4520b5808687464e1ce5081aa4c2ca9fdcb0e64a8d0c3c1f WatchSource:0}: Error finding container 7968d3f6e354171f4520b5808687464e1ce5081aa4c2ca9fdcb0e64a8d0c3c1f: Status 404 returned error can't find the container with id 7968d3f6e354171f4520b5808687464e1ce5081aa4c2ca9fdcb0e64a8d0c3c1f
Jul 30 17:01:37.931083 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:37.929886    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9bcb675bf-2m6c4"]
Jul 30 17:01:37.934330 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:37.934278    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5178ee7e_3787_4167_9ed8_b6f255fc4190.slice/crio-a6b6cef9ed7498f11fc051134d184539a753f89a08dc4b4480448cea311e242d WatchSource:0}: Error finding container a6b6cef9ed7498f11fc051134d184539a753f89a08dc4b4480448cea311e242d: Status 404 returned error can't find the container with id a6b6cef9ed7498f11fc051134d184539a753f89a08dc4b4480448cea311e242d
Jul 30 17:01:38.155626 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.155523    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zsm4g" event={"ID":"9ed19618-5096-494b-b51f-d80f84f2b7a9","Type":"ContainerStarted","Data":"900d35d0be45894e37ac79d2396da39ceec63d796c2d05508a8cee7676aa0be9"}
Jul 30 17:01:38.157076 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.157053    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9jpt5" event={"ID":"f9d1ef43-e1f0-4112-954b-bd0e771f0fee","Type":"ContainerStarted","Data":"286a70e1a1e595f14ee3b3bfd32450ffee365a3df4d06a050e871d0f67652f6d"}
Jul 30 17:01:38.158892 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.158865    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jpxpz" event={"ID":"c8189d07-aacf-4e6e-9d50-01259f44f2b4","Type":"ContainerStarted","Data":"ed9a8ce9bce15b36392396b64f0473b5eb9197f7eaff83b1964bc4765c2413fb"}
Jul 30 17:01:38.159009 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.158930    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jpxpz" event={"ID":"c8189d07-aacf-4e6e-9d50-01259f44f2b4","Type":"ContainerStarted","Data":"e68585556ea0960563e6c0117d98f2626a53950fa970ec8712d9049e90a06944"}
Jul 30 17:01:38.159009 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.158987    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:01:38.160437 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.160414    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9bcb675bf-2m6c4" event={"ID":"5178ee7e-3787-4167-9ed8-b6f255fc4190","Type":"ContainerStarted","Data":"ec7cb53539b3cdc2b0b1976eb6c286ceb42cecaa3fbe7b08aa663d56e58af8da"}
Jul 30 17:01:38.160509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.160453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9bcb675bf-2m6c4" event={"ID":"5178ee7e-3787-4167-9ed8-b6f255fc4190","Type":"ContainerStarted","Data":"a6b6cef9ed7498f11fc051134d184539a753f89a08dc4b4480448cea311e242d"}
Jul 30 17:01:38.161571 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.161523    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f" event={"ID":"0399577e-b99f-4403-a296-04f3e4609d34","Type":"ContainerStarted","Data":"7968d3f6e354171f4520b5808687464e1ce5081aa4c2ca9fdcb0e64a8d0c3c1f"}
Jul 30 17:01:38.172159 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.171526    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zsm4g" podStartSLOduration=65.368332059 podStartE2EDuration="1m13.171507494s" totalImagesPullingTime="7.803175435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:38.170781513 +0000 UTC m=+74.900394012" watchObservedRunningTime="2026-07-30 17:01:38.171507494 +0000 UTC m=+74.901119993"
Jul 30 17:01:38.188039 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.188002    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-9bcb675bf-2m6c4" podStartSLOduration=34.187990177 podStartE2EDuration="34.187990177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:38.187315621 +0000 UTC m=+74.916928146" watchObservedRunningTime="2026-07-30 17:01:38.187990177 +0000 UTC m=+74.917602709"
Jul 30 17:01:38.202863 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.202825    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jpxpz" podStartSLOduration=32.948797422 podStartE2EDuration="39.20281112s" totalImagesPullingTime="6.254013698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:38.202456852 +0000 UTC m=+74.932069379" watchObservedRunningTime="2026-07-30 17:01:38.20281112 +0000 UTC m=+74.932423619"
Jul 30 17:01:38.440648 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.440568    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:38.443660 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:38.443625    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:39.166246 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:39.166211    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:39.167390 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:39.167369    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9bcb675bf-2m6c4"
Jul 30 17:01:43.186816 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:43.186723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f" event={"ID":"0399577e-b99f-4403-a296-04f3e4609d34","Type":"ContainerStarted","Data":"4de72d204548df8e0ac0b676ba8c8fb18f9105b2e5f00c57aa25158db5b04a87"}
Jul 30 17:01:43.188615 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:43.188593    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9jpt5" event={"ID":"f9d1ef43-e1f0-4112-954b-bd0e771f0fee","Type":"ContainerStarted","Data":"8f524830d3809db5252d49934ade04796b0a878c4afac0da62d74c4e09674608"}
Jul 30 17:01:43.205063 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:43.205014    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-s5c9f" podStartSLOduration=34.515996035 podStartE2EDuration="39.204997476s" totalImagesPullingTime="4.689001441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:43.202741648 +0000 UTC m=+79.932354146" watchObservedRunningTime="2026-07-30 17:01:43.204997476 +0000 UTC m=+79.934609975"
Jul 30 17:01:47.207527 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:47.207491    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9jpt5" event={"ID":"f9d1ef43-e1f0-4112-954b-bd0e771f0fee","Type":"ContainerStarted","Data":"eb7065255cec27ca337817727fa8bb4e434d72a11d3b56bac08d93237bbbfb67"}
Jul 30 17:01:47.226254 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:47.226207    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9jpt5" podStartSLOduration=17.357773386 podStartE2EDuration="34.226193878s" totalImagesPullingTime="16.868420492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:01:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:47.22507411 +0000 UTC m=+83.954686645" watchObservedRunningTime="2026-07-30 17:01:47.226193878 +0000 UTC m=+83.955806428"
Jul 30 17:01:48.168441 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:48.168412    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jpxpz"
Jul 30 17:01:49.795535 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:49.795506    2561 scope.go:117] "RemoveContainer" containerID="d3a57393495af59f4b718b5206d1afd74555a6bb17995c26bb726685ae2ba828"
Jul 30 17:01:50.220355 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:50.220332    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:01:50.220489 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:50.220430    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr" event={"ID":"f7f639b3-092f-48bd-81a8-86a3dd28ba5f","Type":"ContainerStarted","Data":"9a95be9c442ab5d2db89de6e73a0d24774ef0957acb6de8511d18ad1d6651c1e"}
Jul 30 17:01:50.220806 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:50.220774    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:50.238708 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:50.238668    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr" podStartSLOduration=40.205259515 podStartE2EDuration="46.238655272s" totalImagesPullingTime="6.033395757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:01:50.237261527 +0000 UTC m=+86.966874052" watchObservedRunningTime="2026-07-30 17:01:50.238655272 +0000 UTC m=+86.968267797"
Jul 30 17:01:50.540585 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:50.540497    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-zjlzr"
Jul 30 17:01:54.140949 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:54.140926    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:01:56.531497 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.531468    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lqhxm"]
Jul 30 17:01:56.537222 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.537204    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.540999 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.540980    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m27tn\""
Jul 30 17:01:56.542092 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.541879    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 17:01:56.542092 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.541907    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 17:01:56.542306 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.542289    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 17:01:56.542729 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.542709    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 17:01:56.643024 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.642995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-textfile\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.643135 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.643036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-tls\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.643135 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.643061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ddb0461-8589-4063-ad33-31da25ddd3da-metrics-client-ca\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.643135 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.643087    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ddb0461-8589-4063-ad33-31da25ddd3da-sys\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.643135 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.643112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.643332 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.643138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmvvn\" (UniqueName: \"kubernetes.io/projected/5ddb0461-8589-4063-ad33-31da25ddd3da-kube-api-access-gmvvn\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.643332 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.643161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ddb0461-8589-4063-ad33-31da25ddd3da-root\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.643332 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.643242    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.643332 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.643299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-wtmp\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744383 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ddb0461-8589-4063-ad33-31da25ddd3da-metrics-client-ca\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744511 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ddb0461-8589-4063-ad33-31da25ddd3da-sys\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744511 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744511 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmvvn\" (UniqueName: \"kubernetes.io/projected/5ddb0461-8589-4063-ad33-31da25ddd3da-kube-api-access-gmvvn\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744511 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ddb0461-8589-4063-ad33-31da25ddd3da-root\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744511 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744482    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ddb0461-8589-4063-ad33-31da25ddd3da-sys\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744793 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744534    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ddb0461-8589-4063-ad33-31da25ddd3da-root\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744793 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744793 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744600    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-wtmp\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744793 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-textfile\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744793 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-tls\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.744793 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744751    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-wtmp\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.745074 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.744977    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.745074 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.745028    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-textfile\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.745074 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.745066    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ddb0461-8589-4063-ad33-31da25ddd3da-metrics-client-ca\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.747047 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.747028    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.747116 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.747066    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ddb0461-8589-4063-ad33-31da25ddd3da-node-exporter-tls\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.754895 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.754875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmvvn\" (UniqueName: \"kubernetes.io/projected/5ddb0461-8589-4063-ad33-31da25ddd3da-kube-api-access-gmvvn\") pod \"node-exporter-lqhxm\" (UID: \"5ddb0461-8589-4063-ad33-31da25ddd3da\") " pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.847669 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:56.847605    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lqhxm"
Jul 30 17:01:56.861115 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:01:56.861095    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ddb0461_8589_4063_ad33_31da25ddd3da.slice/crio-eb353e5535e1961d42725b7c7f65a0a829a508883bd786829225264f0a1a764d WatchSource:0}: Error finding container eb353e5535e1961d42725b7c7f65a0a829a508883bd786829225264f0a1a764d: Status 404 returned error can't find the container with id eb353e5535e1961d42725b7c7f65a0a829a508883bd786829225264f0a1a764d
Jul 30 17:01:57.247793 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:57.247755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqhxm" event={"ID":"5ddb0461-8589-4063-ad33-31da25ddd3da","Type":"ContainerStarted","Data":"eb353e5535e1961d42725b7c7f65a0a829a508883bd786829225264f0a1a764d"}
Jul 30 17:01:57.765882 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:57.765851    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-588d4655-sz8xg"]
Jul 30 17:01:59.260389 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:59.260344    2561 generic.go:356] "Generic (PLEG): container finished" podID="5ddb0461-8589-4063-ad33-31da25ddd3da" containerID="5e0464feab564f8b4ee4562ad2482fb9391f86235ed38a2ba25584f8cabc762a" exitCode=0
Jul 30 17:01:59.260782 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:01:59.260449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqhxm" event={"ID":"5ddb0461-8589-4063-ad33-31da25ddd3da","Type":"ContainerDied","Data":"5e0464feab564f8b4ee4562ad2482fb9391f86235ed38a2ba25584f8cabc762a"}
Jul 30 17:02:00.266595 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:00.266565    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqhxm" event={"ID":"5ddb0461-8589-4063-ad33-31da25ddd3da","Type":"ContainerStarted","Data":"2d8f1058cd9da041bf913de88ce835b958bb2a612d7bef81e16ae34b655ed916"}
Jul 30 17:02:00.267063 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:00.266629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqhxm" event={"ID":"5ddb0461-8589-4063-ad33-31da25ddd3da","Type":"ContainerStarted","Data":"21693d855646ca824c6ee0145f85450428cdb8711748a794dbf0f1f9e1cc6be9"}
Jul 30 17:02:00.287657 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:00.287611    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lqhxm" podStartSLOduration=2.787854844 podStartE2EDuration="4.287597871s" totalImagesPullingTime="1.428872431s" totalInitContainerRuntime="70.870596ms" isStatefulPod=true podCreationTimestamp="2026-07-30 17:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:00.28573585 +0000 UTC m=+97.015348360" watchObservedRunningTime="2026-07-30 17:02:00.287597871 +0000 UTC m=+97.017210368"
Jul 30 17:02:03.134670 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:03.134641    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-59w8z"
Jul 30 17:02:09.427237 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.427207    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d7c8764b5-cxs2w"]
Jul 30 17:02:09.522277 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.522244    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7c8764b5-cxs2w"]
Jul 30 17:02:09.522445 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.522345    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.525523 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.525493    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8spx6\""
Jul 30 17:02:09.525651 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.525592    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 17:02:09.525651 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.525627    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 17:02:09.526688 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.526652    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 17:02:09.526688 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.526652    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 17:02:09.526814 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.526717    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 17:02:09.526814 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.526743    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 17:02:09.526814 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.526758    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 17:02:09.531048 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.531028    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 30 17:02:09.633153 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.633125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-serving-cert\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.633252 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.633181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-service-ca\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.633252 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.633214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-oauth-config\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.633252 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.633241    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-config\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.633404 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.633265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwzbs\" (UniqueName: \"kubernetes.io/projected/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-kube-api-access-fwzbs\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.633404 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.633294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-trusted-ca-bundle\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.633404 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.633327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-oauth-serving-cert\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.734035 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.734014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-service-ca\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.734120 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.734044    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-oauth-config\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.734120 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.734062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-config\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.734120 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.734077    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwzbs\" (UniqueName: \"kubernetes.io/projected/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-kube-api-access-fwzbs\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.734120 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.734103    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-trusted-ca-bundle\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.734313 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.734136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-oauth-serving-cert\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.734313 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.734192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-serving-cert\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.734865 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.734848    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-service-ca\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.734992 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.734971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-oauth-serving-cert\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.735076 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.735063    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-trusted-ca-bundle\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.735112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.735065    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-config\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.736613 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.736589    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-oauth-config\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.736715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.736654    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-serving-cert\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.743765 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.743745    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwzbs\" (UniqueName: \"kubernetes.io/projected/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-kube-api-access-fwzbs\") pod \"console-d7c8764b5-cxs2w\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") " pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.832699 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.832675    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:09.996975 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:09.996903    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7c8764b5-cxs2w"]
Jul 30 17:02:10.000076 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:02:10.000049    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1c4a0f_075b_4ed7_84b1_a5c5a29034a2.slice/crio-624e6fe74cd004b7c158ea348817101c8027125e191be112779351a4e431c0e7 WatchSource:0}: Error finding container 624e6fe74cd004b7c158ea348817101c8027125e191be112779351a4e431c0e7: Status 404 returned error can't find the container with id 624e6fe74cd004b7c158ea348817101c8027125e191be112779351a4e431c0e7
Jul 30 17:02:10.301477 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:10.301420    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7c8764b5-cxs2w" event={"ID":"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2","Type":"ContainerStarted","Data":"624e6fe74cd004b7c158ea348817101c8027125e191be112779351a4e431c0e7"}
Jul 30 17:02:13.315460 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:13.315428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7c8764b5-cxs2w" event={"ID":"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2","Type":"ContainerStarted","Data":"49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1"}
Jul 30 17:02:13.332935 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:13.332886    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d7c8764b5-cxs2w" podStartSLOduration=1.127831206 podStartE2EDuration="4.332872007s" totalImagesPullingTime="3.205040801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:13.332723218 +0000 UTC m=+110.062335748" watchObservedRunningTime="2026-07-30 17:02:13.332872007 +0000 UTC m=+110.062484504"
Jul 30 17:02:19.833752 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:19.833724    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:19.834193 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:19.833765    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:19.838523 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:19.838499    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:20.343244 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:20.343220    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:22.290288 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.290221    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-89874d9ff-qzlvq"]
Jul 30 17:02:22.293378 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.293360    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.304384 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.304360    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89874d9ff-qzlvq"]
Jul 30 17:02:22.329324 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.329293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-serving-cert\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.329419 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.329329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-console-config\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.329419 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.329351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-oauth-config\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.329419 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.329381    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-trusted-ca-bundle\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.329419 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.329396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-oauth-serving-cert\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.329419 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.329419    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8wzc\" (UniqueName: \"kubernetes.io/projected/648fea78-5e41-42d6-97bb-1c574729ea4d-kube-api-access-d8wzc\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.329601 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.329464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-service-ca\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.347243 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.347218    2561 generic.go:356] "Generic (PLEG): container finished" podID="1a86ed67-ee6d-4f89-86df-d2b98c92e6d0" containerID="00075a304e53946e0092491231e86add358714c01c941b598af21ae257c92eb3" exitCode=0
Jul 30 17:02:22.347328 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.347290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck" event={"ID":"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0","Type":"ContainerDied","Data":"00075a304e53946e0092491231e86add358714c01c941b598af21ae257c92eb3"}
Jul 30 17:02:22.347595 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.347582    2561 scope.go:117] "RemoveContainer" containerID="00075a304e53946e0092491231e86add358714c01c941b598af21ae257c92eb3"
Jul 30 17:02:22.430836 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.430808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-oauth-config\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.430983 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.430883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-trusted-ca-bundle\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.430983 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.430901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-oauth-serving-cert\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.430983 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.430930    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8wzc\" (UniqueName: \"kubernetes.io/projected/648fea78-5e41-42d6-97bb-1c574729ea4d-kube-api-access-d8wzc\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.432059 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.431220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-service-ca\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.432059 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.431334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-serving-cert\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.432059 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.431384    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-console-config\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.432059 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.431986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-trusted-ca-bundle\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.432059 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.432019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-console-config\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.432386 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.432121    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-service-ca\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.432820 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.432798    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-oauth-serving-cert\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.433704 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.433685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-oauth-config\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.434893 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.434864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-serving-cert\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.446934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.446889    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8wzc\" (UniqueName: \"kubernetes.io/projected/648fea78-5e41-42d6-97bb-1c574729ea4d-kube-api-access-d8wzc\") pod \"console-89874d9ff-qzlvq\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") " pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.601931 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.601867    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:22.733751 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.733689    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89874d9ff-qzlvq"]
Jul 30 17:02:22.736266 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:02:22.736237    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648fea78_5e41_42d6_97bb_1c574729ea4d.slice/crio-058111263ff7b131beb3ce83125180323694c696041ed68d91454582fff17f5b WatchSource:0}: Error finding container 058111263ff7b131beb3ce83125180323694c696041ed68d91454582fff17f5b: Status 404 returned error can't find the container with id 058111263ff7b131beb3ce83125180323694c696041ed68d91454582fff17f5b
Jul 30 17:02:22.791492 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:22.791446    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-588d4655-sz8xg" podUID="fac44fd1-35de-46a1-b7b0-7689ec6078cc" containerName="registry" containerID="cri-o://71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618" gracePeriod=30
Jul 30 17:02:23.034318 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.034295    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:02:23.137224 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.137195    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fac44fd1-35de-46a1-b7b0-7689ec6078cc-ca-trust-extracted\") pod \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") "
Jul 30 17:02:23.137224 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.137226    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-certificates\") pod \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") "
Jul 30 17:02:23.137463 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.137246    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls\") pod \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") "
Jul 30 17:02:23.137463 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.137271    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv8x7\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-kube-api-access-mv8x7\") pod \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") "
Jul 30 17:02:23.137463 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.137330    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-installation-pull-secrets\") pod \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") "
Jul 30 17:02:23.137463 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.137382    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-trusted-ca\") pod \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") "
Jul 30 17:02:23.137463 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.137414    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-image-registry-private-configuration\") pod \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") "
Jul 30 17:02:23.137463 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.137463    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-bound-sa-token\") pod \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\" (UID: \"fac44fd1-35de-46a1-b7b0-7689ec6078cc\") "
Jul 30 17:02:23.137790 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.137616    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fac44fd1-35de-46a1-b7b0-7689ec6078cc" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:02:23.137790 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.137687    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-certificates\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:23.138332 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.138233    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fac44fd1-35de-46a1-b7b0-7689ec6078cc" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:02:23.140149 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.140110    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fac44fd1-35de-46a1-b7b0-7689ec6078cc" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:02:23.140283 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.140257    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fac44fd1-35de-46a1-b7b0-7689ec6078cc" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:02:23.140355 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.140277    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-kube-api-access-mv8x7" (OuterVolumeSpecName: "kube-api-access-mv8x7") pod "fac44fd1-35de-46a1-b7b0-7689ec6078cc" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc"). InnerVolumeSpecName "kube-api-access-mv8x7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:02:23.140355 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.140342    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fac44fd1-35de-46a1-b7b0-7689ec6078cc" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:02:23.140471 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.140457    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fac44fd1-35de-46a1-b7b0-7689ec6078cc" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:02:23.146049 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.146001    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fac44fd1-35de-46a1-b7b0-7689ec6078cc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fac44fd1-35de-46a1-b7b0-7689ec6078cc" (UID: "fac44fd1-35de-46a1-b7b0-7689ec6078cc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:02:23.238264 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.238234    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-registry-tls\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:23.238264 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.238256    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv8x7\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-kube-api-access-mv8x7\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:23.238264 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.238265    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-installation-pull-secrets\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:23.238460 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.238274    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fac44fd1-35de-46a1-b7b0-7689ec6078cc-trusted-ca\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:23.238460 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.238282    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fac44fd1-35de-46a1-b7b0-7689ec6078cc-image-registry-private-configuration\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:23.238460 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.238291    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fac44fd1-35de-46a1-b7b0-7689ec6078cc-bound-sa-token\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:23.238460 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.238299    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fac44fd1-35de-46a1-b7b0-7689ec6078cc-ca-trust-extracted\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:23.352311 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.352280    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bpdck" event={"ID":"1a86ed67-ee6d-4f89-86df-d2b98c92e6d0","Type":"ContainerStarted","Data":"4a22fbd47d06f58691debfcb487b7afd04eb5ce737283bdf5943716978c09bed"}
Jul 30 17:02:23.353847 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.353822    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89874d9ff-qzlvq" event={"ID":"648fea78-5e41-42d6-97bb-1c574729ea4d","Type":"ContainerStarted","Data":"77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1"}
Jul 30 17:02:23.353931 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.353864    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89874d9ff-qzlvq" event={"ID":"648fea78-5e41-42d6-97bb-1c574729ea4d","Type":"ContainerStarted","Data":"058111263ff7b131beb3ce83125180323694c696041ed68d91454582fff17f5b"}
Jul 30 17:02:23.355051 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.355027    2561 generic.go:356] "Generic (PLEG): container finished" podID="fac44fd1-35de-46a1-b7b0-7689ec6078cc" containerID="71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618" exitCode=0
Jul 30 17:02:23.355141 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.355066    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588d4655-sz8xg"
Jul 30 17:02:23.355141 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.355079    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588d4655-sz8xg" event={"ID":"fac44fd1-35de-46a1-b7b0-7689ec6078cc","Type":"ContainerDied","Data":"71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618"}
Jul 30 17:02:23.355141 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.355118    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588d4655-sz8xg" event={"ID":"fac44fd1-35de-46a1-b7b0-7689ec6078cc","Type":"ContainerDied","Data":"ef0e499bc254e16463a82c0d04250570937944e4a9ab87fcd6f8ca268a945805"}
Jul 30 17:02:23.355250 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.355144    2561 scope.go:117] "RemoveContainer" containerID="71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618"
Jul 30 17:02:23.363681 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.363664    2561 scope.go:117] "RemoveContainer" containerID="71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618"
Jul 30 17:02:23.363955 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:02:23.363930    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618\": container with ID starting with 71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618 not found: ID does not exist" containerID="71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618"
Jul 30 17:02:23.364046 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.363961    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618"} err="failed to get container status \"71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618\": rpc error: code = NotFound desc = could not find container \"71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618\": container with ID starting with 71bf4a2220079d22f76bfa443b0d32ca6876271f87aca8dcca11c6434120a618 not found: ID does not exist"
Jul 30 17:02:23.386182 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.386141    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-89874d9ff-qzlvq" podStartSLOduration=1.386129046 podStartE2EDuration="1.386129046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:02:23.384981786 +0000 UTC m=+120.114594315" watchObservedRunningTime="2026-07-30 17:02:23.386129046 +0000 UTC m=+120.115741549"
Jul 30 17:02:23.396814 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.396760    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-588d4655-sz8xg"]
Jul 30 17:02:23.400878 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.400858    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-588d4655-sz8xg"]
Jul 30 17:02:23.800451 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:23.800417    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fac44fd1-35de-46a1-b7b0-7689ec6078cc" path="/var/lib/kubelet/pods/fac44fd1-35de-46a1-b7b0-7689ec6078cc/volumes"
Jul 30 17:02:28.374863 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:28.374826    2561 generic.go:356] "Generic (PLEG): container finished" podID="a5e39baa-3777-40c0-a8bf-9ee9ac9f2800" containerID="46e01c7f26fae7216ce74916c7dabad4031914132d000d37145ff512e75d8a85" exitCode=0
Jul 30 17:02:28.375246 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:28.374899    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx" event={"ID":"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800","Type":"ContainerDied","Data":"46e01c7f26fae7216ce74916c7dabad4031914132d000d37145ff512e75d8a85"}
Jul 30 17:02:28.375246 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:28.375182    2561 scope.go:117] "RemoveContainer" containerID="46e01c7f26fae7216ce74916c7dabad4031914132d000d37145ff512e75d8a85"
Jul 30 17:02:29.381318 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:29.381288    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx" event={"ID":"a5e39baa-3777-40c0-a8bf-9ee9ac9f2800","Type":"ContainerStarted","Data":"f7878d66e1881866b69d0f3966cbe5883d9e4a0fe10579d81d239e276271ca6a"}
Jul 30 17:02:32.602214 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:32.602184    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:32.602520 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:32.602257    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:32.606921 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:32.606901    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:33.398050 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:33.398019    2561 generic.go:356] "Generic (PLEG): container finished" podID="5e5aec98-ff5b-433e-a248-e4a03acb903a" containerID="fdb23cebe89099e60ca0bab9250543a749e4cfc73dac2e5558b273ef632c0384" exitCode=0
Jul 30 17:02:33.398227 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:33.398098    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-ssf4q" event={"ID":"5e5aec98-ff5b-433e-a248-e4a03acb903a","Type":"ContainerDied","Data":"fdb23cebe89099e60ca0bab9250543a749e4cfc73dac2e5558b273ef632c0384"}
Jul 30 17:02:33.398616 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:33.398587    2561 scope.go:117] "RemoveContainer" containerID="fdb23cebe89099e60ca0bab9250543a749e4cfc73dac2e5558b273ef632c0384"
Jul 30 17:02:33.402333 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:33.402315    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:02:33.461123 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:33.461097    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d7c8764b5-cxs2w"]
Jul 30 17:02:34.403117 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:34.403079    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-ssf4q" event={"ID":"5e5aec98-ff5b-433e-a248-e4a03acb903a","Type":"ContainerStarted","Data":"fdf4aba95b26119a697d3967176cf7afea7852897756a06be54a0aba001ae452"}
Jul 30 17:02:58.485861 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.485787    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d7c8764b5-cxs2w" podUID="cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" containerName="console" containerID="cri-o://49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1" gracePeriod=15
Jul 30 17:02:58.720716 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.720693    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:58.812439 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.812347    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-serving-cert\") pod \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") "
Jul 30 17:02:58.812439 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.812395    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-service-ca\") pod \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") "
Jul 30 17:02:58.812439 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.812418    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-config\") pod \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") "
Jul 30 17:02:58.812439 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.812435    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwzbs\" (UniqueName: \"kubernetes.io/projected/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-kube-api-access-fwzbs\") pod \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") "
Jul 30 17:02:58.812813 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.812456    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-oauth-serving-cert\") pod \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") "
Jul 30 17:02:58.812813 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.812496    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-oauth-config\") pod \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") "
Jul 30 17:02:58.812813 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.812535    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-trusted-ca-bundle\") pod \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\" (UID: \"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2\") "
Jul 30 17:02:58.812951 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.812846    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" (UID: "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:02:58.812951 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.812845    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-config" (OuterVolumeSpecName: "console-config") pod "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" (UID: "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:02:58.813073 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.813045    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" (UID: "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:02:58.813188 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.813160    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" (UID: "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:02:58.815111 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.815078    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" (UID: "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:02:58.815272 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.815120    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-kube-api-access-fwzbs" (OuterVolumeSpecName: "kube-api-access-fwzbs") pod "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" (UID: "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2"). InnerVolumeSpecName "kube-api-access-fwzbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:02:58.815272 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.815135    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" (UID: "cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:02:58.913753 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.913715    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-trusted-ca-bundle\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:58.913753 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.913743    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-serving-cert\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:58.913753 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.913752    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-service-ca\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:58.913753 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.913761    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:58.913753 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.913768    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwzbs\" (UniqueName: \"kubernetes.io/projected/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-kube-api-access-fwzbs\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:58.914044 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.913776    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-oauth-serving-cert\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:58.914044 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:58.913784    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2-console-oauth-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:02:59.501433 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:59.501399    2561 generic.go:356] "Generic (PLEG): container finished" podID="cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" containerID="49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1" exitCode=0
Jul 30 17:02:59.501925 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:59.501449    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7c8764b5-cxs2w"
Jul 30 17:02:59.501925 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:59.501483    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7c8764b5-cxs2w" event={"ID":"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2","Type":"ContainerDied","Data":"49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1"}
Jul 30 17:02:59.501925 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:59.501536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7c8764b5-cxs2w" event={"ID":"cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2","Type":"ContainerDied","Data":"624e6fe74cd004b7c158ea348817101c8027125e191be112779351a4e431c0e7"}
Jul 30 17:02:59.501925 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:59.501572    2561 scope.go:117] "RemoveContainer" containerID="49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1"
Jul 30 17:02:59.510435 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:59.510420    2561 scope.go:117] "RemoveContainer" containerID="49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1"
Jul 30 17:02:59.510745 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:02:59.510724    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1\": container with ID starting with 49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1 not found: ID does not exist" containerID="49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1"
Jul 30 17:02:59.510841 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:59.510750    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1"} err="failed to get container status \"49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1\": rpc error: code = NotFound desc = could not find container \"49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1\": container with ID starting with 49bc9c6f56ab6bb4de1fa1f7d76692cbf8585a3f7fc14c9a481c5745dab786b1 not found: ID does not exist"
Jul 30 17:02:59.521248 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:59.521229    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d7c8764b5-cxs2w"]
Jul 30 17:02:59.525751 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:59.525732    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d7c8764b5-cxs2w"]
Jul 30 17:02:59.800260 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:02:59.800169    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" path="/var/lib/kubelet/pods/cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2/volumes"
Jul 30 17:03:50.727886 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.727834    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-998dd449b-5t46k"]
Jul 30 17:03:50.728480 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.728232    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac44fd1-35de-46a1-b7b0-7689ec6078cc" containerName="registry"
Jul 30 17:03:50.728480 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.728252    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac44fd1-35de-46a1-b7b0-7689ec6078cc" containerName="registry"
Jul 30 17:03:50.728480 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.728272    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" containerName="console"
Jul 30 17:03:50.728480 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.728280    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" containerName="console"
Jul 30 17:03:50.728480 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.728375    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac44fd1-35de-46a1-b7b0-7689ec6078cc" containerName="registry"
Jul 30 17:03:50.728480 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.728388    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1c4a0f-075b-4ed7-84b1-a5c5a29034a2" containerName="console"
Jul 30 17:03:50.731201 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.731180    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.739924 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.739901    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-998dd449b-5t46k"]
Jul 30 17:03:50.808203 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.808169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl5zm\" (UniqueName: \"kubernetes.io/projected/c38be431-072d-4d2f-a254-01149c0c42e6-kube-api-access-sl5zm\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.808379 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.808213    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-console-config\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.808379 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.808238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-serving-cert\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.808379 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.808323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-oauth-config\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.808379 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.808349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-trusted-ca-bundle\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.808611 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.808387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-service-ca\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.808611 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.808473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-oauth-serving-cert\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.909867 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.909832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-oauth-config\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.910053 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.909881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-trusted-ca-bundle\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.910053 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.909915    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-service-ca\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.910053 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.909947    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-oauth-serving-cert\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.910053 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.909970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl5zm\" (UniqueName: \"kubernetes.io/projected/c38be431-072d-4d2f-a254-01149c0c42e6-kube-api-access-sl5zm\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.910053 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.910012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-console-config\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.910053 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.910047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-serving-cert\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.910832 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.910797    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-service-ca\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.910972 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.910894    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-console-config\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.911070 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.911044    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-oauth-serving-cert\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.911172 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.911151    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-trusted-ca-bundle\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.912437 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.912409    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-oauth-config\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.912531 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.912508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-serving-cert\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:50.917978 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:50.917957    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl5zm\" (UniqueName: \"kubernetes.io/projected/c38be431-072d-4d2f-a254-01149c0c42e6-kube-api-access-sl5zm\") pod \"console-998dd449b-5t46k\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") " pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:51.042265 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:51.042170    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:03:51.175735 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:51.175692    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-998dd449b-5t46k"]
Jul 30 17:03:51.178595 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:03:51.178563    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38be431_072d_4d2f_a254_01149c0c42e6.slice/crio-1caa79e0b6b8da6da445593b908b1ee1a2dc1ee7a5059908a2676c681991d9f9 WatchSource:0}: Error finding container 1caa79e0b6b8da6da445593b908b1ee1a2dc1ee7a5059908a2676c681991d9f9: Status 404 returned error can't find the container with id 1caa79e0b6b8da6da445593b908b1ee1a2dc1ee7a5059908a2676c681991d9f9
Jul 30 17:03:51.688204 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:51.688174    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998dd449b-5t46k" event={"ID":"c38be431-072d-4d2f-a254-01149c0c42e6","Type":"ContainerStarted","Data":"3972ebda3f46b61cc91379df8df4ea7dc607663807f377e054506242afdc60b2"}
Jul 30 17:03:51.688353 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:51.688220    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998dd449b-5t46k" event={"ID":"c38be431-072d-4d2f-a254-01149c0c42e6","Type":"ContainerStarted","Data":"1caa79e0b6b8da6da445593b908b1ee1a2dc1ee7a5059908a2676c681991d9f9"}
Jul 30 17:03:51.708316 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:03:51.708247    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-998dd449b-5t46k" podStartSLOduration=1.708229614 podStartE2EDuration="1.708229614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:03:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:03:51.706684244 +0000 UTC m=+208.436296761" watchObservedRunningTime="2026-07-30 17:03:51.708229614 +0000 UTC m=+208.437842112"
Jul 30 17:04:01.043025 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:01.042989    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:04:01.043452 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:01.043048    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:04:01.047688 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:01.047668    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:04:01.727511 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:01.727487    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:04:01.774129 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:01.774101    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-89874d9ff-qzlvq"]
Jul 30 17:04:26.795614 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:26.795568    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-89874d9ff-qzlvq" podUID="648fea78-5e41-42d6-97bb-1c574729ea4d" containerName="console" containerID="cri-o://77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1" gracePeriod=15
Jul 30 17:04:27.035892 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.035868    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:04:27.192278 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.192182    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-console-config\") pod \"648fea78-5e41-42d6-97bb-1c574729ea4d\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") "
Jul 30 17:04:27.192278 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.192256    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-oauth-serving-cert\") pod \"648fea78-5e41-42d6-97bb-1c574729ea4d\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") "
Jul 30 17:04:27.192524 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.192368    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-oauth-config\") pod \"648fea78-5e41-42d6-97bb-1c574729ea4d\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") "
Jul 30 17:04:27.192524 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.192413    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-trusted-ca-bundle\") pod \"648fea78-5e41-42d6-97bb-1c574729ea4d\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") "
Jul 30 17:04:27.192524 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.192437    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-service-ca\") pod \"648fea78-5e41-42d6-97bb-1c574729ea4d\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") "
Jul 30 17:04:27.192524 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.192477    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8wzc\" (UniqueName: \"kubernetes.io/projected/648fea78-5e41-42d6-97bb-1c574729ea4d-kube-api-access-d8wzc\") pod \"648fea78-5e41-42d6-97bb-1c574729ea4d\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") "
Jul 30 17:04:27.192524 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.192516    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-serving-cert\") pod \"648fea78-5e41-42d6-97bb-1c574729ea4d\" (UID: \"648fea78-5e41-42d6-97bb-1c574729ea4d\") "
Jul 30 17:04:27.192848 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.192611    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "648fea78-5e41-42d6-97bb-1c574729ea4d" (UID: "648fea78-5e41-42d6-97bb-1c574729ea4d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:04:27.192848 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.192766    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-console-config" (OuterVolumeSpecName: "console-config") pod "648fea78-5e41-42d6-97bb-1c574729ea4d" (UID: "648fea78-5e41-42d6-97bb-1c574729ea4d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:04:27.192955 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.192889    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-service-ca" (OuterVolumeSpecName: "service-ca") pod "648fea78-5e41-42d6-97bb-1c574729ea4d" (UID: "648fea78-5e41-42d6-97bb-1c574729ea4d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:04:27.192955 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.192922    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "648fea78-5e41-42d6-97bb-1c574729ea4d" (UID: "648fea78-5e41-42d6-97bb-1c574729ea4d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:04:27.194781 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.194756    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "648fea78-5e41-42d6-97bb-1c574729ea4d" (UID: "648fea78-5e41-42d6-97bb-1c574729ea4d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:04:27.194886 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.194802    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "648fea78-5e41-42d6-97bb-1c574729ea4d" (UID: "648fea78-5e41-42d6-97bb-1c574729ea4d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:04:27.194924 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.194892    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/648fea78-5e41-42d6-97bb-1c574729ea4d-kube-api-access-d8wzc" (OuterVolumeSpecName: "kube-api-access-d8wzc") pod "648fea78-5e41-42d6-97bb-1c574729ea4d" (UID: "648fea78-5e41-42d6-97bb-1c574729ea4d"). InnerVolumeSpecName "kube-api-access-d8wzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:04:27.293416 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.293378    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8wzc\" (UniqueName: \"kubernetes.io/projected/648fea78-5e41-42d6-97bb-1c574729ea4d-kube-api-access-d8wzc\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:04:27.293416 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.293406    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-serving-cert\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:04:27.293416 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.293417    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-console-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:04:27.293416 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.293427    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-oauth-serving-cert\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:04:27.293722 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.293435    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/648fea78-5e41-42d6-97bb-1c574729ea4d-console-oauth-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:04:27.293722 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.293444    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-trusted-ca-bundle\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:04:27.293722 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.293453    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/648fea78-5e41-42d6-97bb-1c574729ea4d-service-ca\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:04:27.817780 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.817747    2561 generic.go:356] "Generic (PLEG): container finished" podID="648fea78-5e41-42d6-97bb-1c574729ea4d" containerID="77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1" exitCode=0
Jul 30 17:04:27.818187 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.817786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89874d9ff-qzlvq" event={"ID":"648fea78-5e41-42d6-97bb-1c574729ea4d","Type":"ContainerDied","Data":"77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1"}
Jul 30 17:04:27.818187 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.817809    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89874d9ff-qzlvq"
Jul 30 17:04:27.818187 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.817824    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89874d9ff-qzlvq" event={"ID":"648fea78-5e41-42d6-97bb-1c574729ea4d","Type":"ContainerDied","Data":"058111263ff7b131beb3ce83125180323694c696041ed68d91454582fff17f5b"}
Jul 30 17:04:27.818187 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.817844    2561 scope.go:117] "RemoveContainer" containerID="77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1"
Jul 30 17:04:27.828334 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.828315    2561 scope.go:117] "RemoveContainer" containerID="77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1"
Jul 30 17:04:27.828638 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:04:27.828616    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1\": container with ID starting with 77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1 not found: ID does not exist" containerID="77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1"
Jul 30 17:04:27.828715 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.828651    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1"} err="failed to get container status \"77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1\": rpc error: code = NotFound desc = could not find container \"77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1\": container with ID starting with 77ad8e7038ce3bed77f8496a8836914a8ed26dc4a757e844b74ee9072416c5b1 not found: ID does not exist"
Jul 30 17:04:27.835948 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.835922    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-89874d9ff-qzlvq"]
Jul 30 17:04:27.837896 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:27.837874    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-89874d9ff-qzlvq"]
Jul 30 17:04:29.801448 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:29.801402    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="648fea78-5e41-42d6-97bb-1c574729ea4d" path="/var/lib/kubelet/pods/648fea78-5e41-42d6-97bb-1c574729ea4d/volumes"
Jul 30 17:04:46.800317 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.800237    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"]
Jul 30 17:04:46.800714 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.800520    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648fea78-5e41-42d6-97bb-1c574729ea4d" containerName="console"
Jul 30 17:04:46.800714 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.800530    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="648fea78-5e41-42d6-97bb-1c574729ea4d" containerName="console"
Jul 30 17:04:46.800714 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.800611    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="648fea78-5e41-42d6-97bb-1c574729ea4d" containerName="console"
Jul 30 17:04:46.803511 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.803495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:04:46.806324 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.806299    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 17:04:46.807406 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.807378    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 17:04:46.807516 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.807387    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-frggm\""
Jul 30 17:04:46.812446 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.812412    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"]
Jul 30 17:04:46.836714 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.836685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:04:46.836714 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.836715    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:04:46.836899 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.836816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjjg4\" (UniqueName: \"kubernetes.io/projected/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-kube-api-access-mjjg4\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:04:46.937622 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.937579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjjg4\" (UniqueName: \"kubernetes.io/projected/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-kube-api-access-mjjg4\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:04:46.937814 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.937649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:04:46.937814 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.937676    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:04:46.938038 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.938022    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:04:46.938082 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.938054    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:04:46.947526 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:46.947500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjjg4\" (UniqueName: \"kubernetes.io/projected/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-kube-api-access-mjjg4\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:04:47.114114 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:47.114022    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:04:47.245324 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:47.245293    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"]
Jul 30 17:04:47.248625 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:04:47.248599    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b0a149_6ea8_466f_aa5f_f4b4a1606e56.slice/crio-6ecdab42caf14ff5758e10ef60ee916945698e52f331c7f93411a2e28f9a7e86 WatchSource:0}: Error finding container 6ecdab42caf14ff5758e10ef60ee916945698e52f331c7f93411a2e28f9a7e86: Status 404 returned error can't find the container with id 6ecdab42caf14ff5758e10ef60ee916945698e52f331c7f93411a2e28f9a7e86
Jul 30 17:04:47.889974 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:47.889941    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85" event={"ID":"04b0a149-6ea8-466f-aa5f-f4b4a1606e56","Type":"ContainerStarted","Data":"6ecdab42caf14ff5758e10ef60ee916945698e52f331c7f93411a2e28f9a7e86"}
Jul 30 17:04:55.922201 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:55.922111    2561 generic.go:356] "Generic (PLEG): container finished" podID="04b0a149-6ea8-466f-aa5f-f4b4a1606e56" containerID="166d69255b5eb473eabea9c6317817c189b308c3fb2d40b8aaeef2f13b54f260" exitCode=0
Jul 30 17:04:55.922601 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:55.922191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85" event={"ID":"04b0a149-6ea8-466f-aa5f-f4b4a1606e56","Type":"ContainerDied","Data":"166d69255b5eb473eabea9c6317817c189b308c3fb2d40b8aaeef2f13b54f260"}
Jul 30 17:04:58.935812 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:58.935776    2561 generic.go:356] "Generic (PLEG): container finished" podID="04b0a149-6ea8-466f-aa5f-f4b4a1606e56" containerID="00006734e117aac42d3b5d53d638dd005f555705d352540751cdf757a4c97d0a" exitCode=0
Jul 30 17:04:58.936229 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:04:58.935863    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85" event={"ID":"04b0a149-6ea8-466f-aa5f-f4b4a1606e56","Type":"ContainerDied","Data":"00006734e117aac42d3b5d53d638dd005f555705d352540751cdf757a4c97d0a"}
Jul 30 17:05:06.970445 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:06.970412    2561 generic.go:356] "Generic (PLEG): container finished" podID="04b0a149-6ea8-466f-aa5f-f4b4a1606e56" containerID="24271002f83a5ba0a770ae79e3a3b3b36853975c4b35b721a7ac379577110209" exitCode=0
Jul 30 17:05:06.970817 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:06.970478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85" event={"ID":"04b0a149-6ea8-466f-aa5f-f4b4a1606e56","Type":"ContainerDied","Data":"24271002f83a5ba0a770ae79e3a3b3b36853975c4b35b721a7ac379577110209"}
Jul 30 17:05:08.105938 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.105913    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:05:08.219771 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.219740    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-bundle\") pod \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") "
Jul 30 17:05:08.219918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.219782    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-util\") pod \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") "
Jul 30 17:05:08.219918 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.219840    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjjg4\" (UniqueName: \"kubernetes.io/projected/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-kube-api-access-mjjg4\") pod \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\" (UID: \"04b0a149-6ea8-466f-aa5f-f4b4a1606e56\") "
Jul 30 17:05:08.220492 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.220398    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-bundle" (OuterVolumeSpecName: "bundle") pod "04b0a149-6ea8-466f-aa5f-f4b4a1606e56" (UID: "04b0a149-6ea8-466f-aa5f-f4b4a1606e56"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:05:08.222044 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.222023    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-kube-api-access-mjjg4" (OuterVolumeSpecName: "kube-api-access-mjjg4") pod "04b0a149-6ea8-466f-aa5f-f4b4a1606e56" (UID: "04b0a149-6ea8-466f-aa5f-f4b4a1606e56"). InnerVolumeSpecName "kube-api-access-mjjg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:05:08.224269 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.224246    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-util" (OuterVolumeSpecName: "util") pod "04b0a149-6ea8-466f-aa5f-f4b4a1606e56" (UID: "04b0a149-6ea8-466f-aa5f-f4b4a1606e56"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:05:08.320291 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.320227    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjjg4\" (UniqueName: \"kubernetes.io/projected/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-kube-api-access-mjjg4\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:05:08.320291 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.320254    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-bundle\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:05:08.320291 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.320266    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04b0a149-6ea8-466f-aa5f-f4b4a1606e56-util\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:05:08.980450 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.980413    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85" event={"ID":"04b0a149-6ea8-466f-aa5f-f4b4a1606e56","Type":"ContainerDied","Data":"6ecdab42caf14ff5758e10ef60ee916945698e52f331c7f93411a2e28f9a7e86"}
Jul 30 17:05:08.980450 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.980455    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b596f85"
Jul 30 17:05:08.980682 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:08.980464    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ecdab42caf14ff5758e10ef60ee916945698e52f331c7f93411a2e28f9a7e86"
Jul 30 17:05:14.095727 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.095699    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"]
Jul 30 17:05:14.096095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.095982    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04b0a149-6ea8-466f-aa5f-f4b4a1606e56" containerName="util"
Jul 30 17:05:14.096095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.095993    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04b0a149-6ea8-466f-aa5f-f4b4a1606e56" containerName="util"
Jul 30 17:05:14.096095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.096007    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04b0a149-6ea8-466f-aa5f-f4b4a1606e56" containerName="pull"
Jul 30 17:05:14.096095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.096013    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04b0a149-6ea8-466f-aa5f-f4b4a1606e56" containerName="pull"
Jul 30 17:05:14.096095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.096021    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04b0a149-6ea8-466f-aa5f-f4b4a1606e56" containerName="extract"
Jul 30 17:05:14.096095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.096026    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04b0a149-6ea8-466f-aa5f-f4b4a1606e56" containerName="extract"
Jul 30 17:05:14.096095 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.096068    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="04b0a149-6ea8-466f-aa5f-f4b4a1606e56" containerName="extract"
Jul 30 17:05:14.102429 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.102407    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"
Jul 30 17:05:14.104992 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.104971    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 30 17:05:14.105134 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.105007    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-j77kv\""
Jul 30 17:05:14.105134 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.104977    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 30 17:05:14.105134 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.105056    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 30 17:05:14.111221 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.111199    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"]
Jul 30 17:05:14.266736 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.266705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxplt\" (UniqueName: \"kubernetes.io/projected/334d7664-663a-452b-8d43-1e28c79e236e-kube-api-access-hxplt\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx\" (UID: \"334d7664-663a-452b-8d43-1e28c79e236e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"
Jul 30 17:05:14.266882 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.266763    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/334d7664-663a-452b-8d43-1e28c79e236e-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx\" (UID: \"334d7664-663a-452b-8d43-1e28c79e236e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"
Jul 30 17:05:14.367594 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.367495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/334d7664-663a-452b-8d43-1e28c79e236e-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx\" (UID: \"334d7664-663a-452b-8d43-1e28c79e236e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"
Jul 30 17:05:14.367711 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.367593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxplt\" (UniqueName: \"kubernetes.io/projected/334d7664-663a-452b-8d43-1e28c79e236e-kube-api-access-hxplt\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx\" (UID: \"334d7664-663a-452b-8d43-1e28c79e236e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"
Jul 30 17:05:14.369860 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.369841    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/334d7664-663a-452b-8d43-1e28c79e236e-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx\" (UID: \"334d7664-663a-452b-8d43-1e28c79e236e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"
Jul 30 17:05:14.385877 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.385852    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxplt\" (UniqueName: \"kubernetes.io/projected/334d7664-663a-452b-8d43-1e28c79e236e-kube-api-access-hxplt\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx\" (UID: \"334d7664-663a-452b-8d43-1e28c79e236e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"
Jul 30 17:05:14.412513 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.412496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"
Jul 30 17:05:14.545089 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:14.545062    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"]
Jul 30 17:05:14.547629 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:05:14.547601    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334d7664_663a_452b_8d43_1e28c79e236e.slice/crio-121cb2f7f731d26c2f2baeea96115289e0d3c98ace1cd90e092d9eaf57f96e60 WatchSource:0}: Error finding container 121cb2f7f731d26c2f2baeea96115289e0d3c98ace1cd90e092d9eaf57f96e60: Status 404 returned error can't find the container with id 121cb2f7f731d26c2f2baeea96115289e0d3c98ace1cd90e092d9eaf57f96e60
Jul 30 17:05:15.003779 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:15.003747    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx" event={"ID":"334d7664-663a-452b-8d43-1e28c79e236e","Type":"ContainerStarted","Data":"121cb2f7f731d26c2f2baeea96115289e0d3c98ace1cd90e092d9eaf57f96e60"}
Jul 30 17:05:18.018968 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.018936    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx" event={"ID":"334d7664-663a-452b-8d43-1e28c79e236e","Type":"ContainerStarted","Data":"546bae49924585596c361985b57146214f6491904eec0043bfaa77efd0bdcbca"}
Jul 30 17:05:18.019316 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.019003    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"
Jul 30 17:05:18.053243 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.053200    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx" podStartSLOduration=1.041051026 podStartE2EDuration="4.05318426s" totalImagesPullingTime="3.012133234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:05:18.050918127 +0000 UTC m=+294.780530625" watchObservedRunningTime="2026-07-30 17:05:18.05318426 +0000 UTC m=+294.782796757"
Jul 30 17:05:18.292824 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.292748    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-d9zfn"]
Jul 30 17:05:18.295958 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.295943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:18.298523 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.298505    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 30 17:05:18.298882 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.298869    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 30 17:05:18.299100 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.299087    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-jmzj5\""
Jul 30 17:05:18.306671 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.306649    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-d9zfn"]
Jul 30 17:05:18.404328 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.404305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/53120c63-3815-4554-87fe-e3e327f87d7b-cabundle0\") pod \"keda-operator-77f648d694-d9zfn\" (UID: \"53120c63-3815-4554-87fe-e3e327f87d7b\") " pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:18.404483 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.404358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxwg4\" (UniqueName: \"kubernetes.io/projected/53120c63-3815-4554-87fe-e3e327f87d7b-kube-api-access-lxwg4\") pod \"keda-operator-77f648d694-d9zfn\" (UID: \"53120c63-3815-4554-87fe-e3e327f87d7b\") " pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:18.404483 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.404406    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/53120c63-3815-4554-87fe-e3e327f87d7b-certificates\") pod \"keda-operator-77f648d694-d9zfn\" (UID: \"53120c63-3815-4554-87fe-e3e327f87d7b\") " pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:18.509576 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.508871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxwg4\" (UniqueName: \"kubernetes.io/projected/53120c63-3815-4554-87fe-e3e327f87d7b-kube-api-access-lxwg4\") pod \"keda-operator-77f648d694-d9zfn\" (UID: \"53120c63-3815-4554-87fe-e3e327f87d7b\") " pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:18.509576 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.508927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/53120c63-3815-4554-87fe-e3e327f87d7b-certificates\") pod \"keda-operator-77f648d694-d9zfn\" (UID: \"53120c63-3815-4554-87fe-e3e327f87d7b\") " pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:18.509576 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.508969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/53120c63-3815-4554-87fe-e3e327f87d7b-cabundle0\") pod \"keda-operator-77f648d694-d9zfn\" (UID: \"53120c63-3815-4554-87fe-e3e327f87d7b\") " pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:18.509818 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.509676    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/53120c63-3815-4554-87fe-e3e327f87d7b-cabundle0\") pod \"keda-operator-77f648d694-d9zfn\" (UID: \"53120c63-3815-4554-87fe-e3e327f87d7b\") " pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:18.510572 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:05:18.510063    2561 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jul 30 17:05:18.510572 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:05:18.510085    2561 secret.go:281] references non-existent secret key: ca.crt
Jul 30 17:05:18.510572 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:05:18.510096    2561 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 30 17:05:18.510572 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:05:18.510109    2561 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-d9zfn: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 30 17:05:18.510572 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:05:18.510159    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53120c63-3815-4554-87fe-e3e327f87d7b-certificates podName:53120c63-3815-4554-87fe-e3e327f87d7b nodeName:}" failed. No retries permitted until 2026-07-30 17:05:19.010142001 +0000 UTC m=+295.739754496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/53120c63-3815-4554-87fe-e3e327f87d7b-certificates") pod "keda-operator-77f648d694-d9zfn" (UID: "53120c63-3815-4554-87fe-e3e327f87d7b") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 30 17:05:18.518359 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.518337    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxwg4\" (UniqueName: \"kubernetes.io/projected/53120c63-3815-4554-87fe-e3e327f87d7b-kube-api-access-lxwg4\") pod \"keda-operator-77f648d694-d9zfn\" (UID: \"53120c63-3815-4554-87fe-e3e327f87d7b\") " pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:18.727020 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.726997    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"]
Jul 30 17:05:18.730356 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.730340    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:18.733137 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.733118    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 30 17:05:18.740744 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.740721    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"]
Jul 30 17:05:18.810651 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.810627    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9bf9d49e-2506-45da-818d-58adb14f9a0c-certificates\") pod \"keda-metrics-apiserver-55557df8c-bl2rc\" (UID: \"9bf9d49e-2506-45da-818d-58adb14f9a0c\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:18.810837 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.810670    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9bf9d49e-2506-45da-818d-58adb14f9a0c-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-bl2rc\" (UID: \"9bf9d49e-2506-45da-818d-58adb14f9a0c\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:18.810837 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.810706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jqcz\" (UniqueName: \"kubernetes.io/projected/9bf9d49e-2506-45da-818d-58adb14f9a0c-kube-api-access-2jqcz\") pod \"keda-metrics-apiserver-55557df8c-bl2rc\" (UID: \"9bf9d49e-2506-45da-818d-58adb14f9a0c\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:18.911527 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.911498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9bf9d49e-2506-45da-818d-58adb14f9a0c-certificates\") pod \"keda-metrics-apiserver-55557df8c-bl2rc\" (UID: \"9bf9d49e-2506-45da-818d-58adb14f9a0c\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:18.911698 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.911578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9bf9d49e-2506-45da-818d-58adb14f9a0c-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-bl2rc\" (UID: \"9bf9d49e-2506-45da-818d-58adb14f9a0c\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:18.911698 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.911625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqcz\" (UniqueName: \"kubernetes.io/projected/9bf9d49e-2506-45da-818d-58adb14f9a0c-kube-api-access-2jqcz\") pod \"keda-metrics-apiserver-55557df8c-bl2rc\" (UID: \"9bf9d49e-2506-45da-818d-58adb14f9a0c\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:18.911698 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:05:18.911645    2561 secret.go:281] references non-existent secret key: tls.crt
Jul 30 17:05:18.911698 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:05:18.911667    2561 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jul 30 17:05:18.911698 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:05:18.911691    2561 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc: references non-existent secret key: tls.crt
Jul 30 17:05:18.911950 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:05:18.911754    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf9d49e-2506-45da-818d-58adb14f9a0c-certificates podName:9bf9d49e-2506-45da-818d-58adb14f9a0c nodeName:}" failed. No retries permitted until 2026-07-30 17:05:19.411736083 +0000 UTC m=+296.141348562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/9bf9d49e-2506-45da-818d-58adb14f9a0c-certificates") pod "keda-metrics-apiserver-55557df8c-bl2rc" (UID: "9bf9d49e-2506-45da-818d-58adb14f9a0c") : references non-existent secret key: tls.crt
Jul 30 17:05:18.911950 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.911941    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/9bf9d49e-2506-45da-818d-58adb14f9a0c-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-bl2rc\" (UID: \"9bf9d49e-2506-45da-818d-58adb14f9a0c\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:18.920214 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:18.920191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jqcz\" (UniqueName: \"kubernetes.io/projected/9bf9d49e-2506-45da-818d-58adb14f9a0c-kube-api-access-2jqcz\") pod \"keda-metrics-apiserver-55557df8c-bl2rc\" (UID: \"9bf9d49e-2506-45da-818d-58adb14f9a0c\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:19.012961 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.012904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/53120c63-3815-4554-87fe-e3e327f87d7b-certificates\") pod \"keda-operator-77f648d694-d9zfn\" (UID: \"53120c63-3815-4554-87fe-e3e327f87d7b\") " pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:19.015203 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.015182    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/53120c63-3815-4554-87fe-e3e327f87d7b-certificates\") pod \"keda-operator-77f648d694-d9zfn\" (UID: \"53120c63-3815-4554-87fe-e3e327f87d7b\") " pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:19.163068 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.163032    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-2hwnr"]
Jul 30 17:05:19.165993 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.165973    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-2hwnr"
Jul 30 17:05:19.168643 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.168622    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 30 17:05:19.176266 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.176246    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-2hwnr"]
Jul 30 17:05:19.206692 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.206671    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:19.316062 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.316028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcbjc\" (UniqueName: \"kubernetes.io/projected/401ef632-8620-49d8-85eb-0cf85282e227-kube-api-access-dcbjc\") pod \"keda-admission-56f9798bb4-2hwnr\" (UID: \"401ef632-8620-49d8-85eb-0cf85282e227\") " pod="openshift-keda/keda-admission-56f9798bb4-2hwnr"
Jul 30 17:05:19.316214 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.316072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/401ef632-8620-49d8-85eb-0cf85282e227-certificates\") pod \"keda-admission-56f9798bb4-2hwnr\" (UID: \"401ef632-8620-49d8-85eb-0cf85282e227\") " pod="openshift-keda/keda-admission-56f9798bb4-2hwnr"
Jul 30 17:05:19.339842 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.339814    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-d9zfn"]
Jul 30 17:05:19.342692 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:05:19.342663    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53120c63_3815_4554_87fe_e3e327f87d7b.slice/crio-23064cb89863886be00eb0e2331f5705cf86dd687ddd338d12bed1695f8aebc5 WatchSource:0}: Error finding container 23064cb89863886be00eb0e2331f5705cf86dd687ddd338d12bed1695f8aebc5: Status 404 returned error can't find the container with id 23064cb89863886be00eb0e2331f5705cf86dd687ddd338d12bed1695f8aebc5
Jul 30 17:05:19.416892 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.416863    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/401ef632-8620-49d8-85eb-0cf85282e227-certificates\") pod \"keda-admission-56f9798bb4-2hwnr\" (UID: \"401ef632-8620-49d8-85eb-0cf85282e227\") " pod="openshift-keda/keda-admission-56f9798bb4-2hwnr"
Jul 30 17:05:19.417067 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.416939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9bf9d49e-2506-45da-818d-58adb14f9a0c-certificates\") pod \"keda-metrics-apiserver-55557df8c-bl2rc\" (UID: \"9bf9d49e-2506-45da-818d-58adb14f9a0c\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:19.417067 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.416968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcbjc\" (UniqueName: \"kubernetes.io/projected/401ef632-8620-49d8-85eb-0cf85282e227-kube-api-access-dcbjc\") pod \"keda-admission-56f9798bb4-2hwnr\" (UID: \"401ef632-8620-49d8-85eb-0cf85282e227\") " pod="openshift-keda/keda-admission-56f9798bb4-2hwnr"
Jul 30 17:05:19.419483 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.419454    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/401ef632-8620-49d8-85eb-0cf85282e227-certificates\") pod \"keda-admission-56f9798bb4-2hwnr\" (UID: \"401ef632-8620-49d8-85eb-0cf85282e227\") " pod="openshift-keda/keda-admission-56f9798bb4-2hwnr"
Jul 30 17:05:19.419613 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.419511    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9bf9d49e-2506-45da-818d-58adb14f9a0c-certificates\") pod \"keda-metrics-apiserver-55557df8c-bl2rc\" (UID: \"9bf9d49e-2506-45da-818d-58adb14f9a0c\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:19.426333 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.426274    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcbjc\" (UniqueName: \"kubernetes.io/projected/401ef632-8620-49d8-85eb-0cf85282e227-kube-api-access-dcbjc\") pod \"keda-admission-56f9798bb4-2hwnr\" (UID: \"401ef632-8620-49d8-85eb-0cf85282e227\") " pod="openshift-keda/keda-admission-56f9798bb4-2hwnr"
Jul 30 17:05:19.477150 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.477117    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-2hwnr"
Jul 30 17:05:19.612320 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.612291    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-2hwnr"]
Jul 30 17:05:19.641592 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.641538    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:19.776897 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:19.776861    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"]
Jul 30 17:05:19.779969 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:05:19.779936    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf9d49e_2506_45da_818d_58adb14f9a0c.slice/crio-144766cffc07b551d3434d7fe9269ad648db0d5285eb3ea7f611edb79fdc971d WatchSource:0}: Error finding container 144766cffc07b551d3434d7fe9269ad648db0d5285eb3ea7f611edb79fdc971d: Status 404 returned error can't find the container with id 144766cffc07b551d3434d7fe9269ad648db0d5285eb3ea7f611edb79fdc971d
Jul 30 17:05:20.027786 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:20.027741    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-2hwnr" event={"ID":"401ef632-8620-49d8-85eb-0cf85282e227","Type":"ContainerStarted","Data":"115736bae3f774abc1eb4e0d32f8fcf6331820c5c99f234b88c24d43fa260781"}
Jul 30 17:05:20.028841 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:20.028815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc" event={"ID":"9bf9d49e-2506-45da-818d-58adb14f9a0c","Type":"ContainerStarted","Data":"144766cffc07b551d3434d7fe9269ad648db0d5285eb3ea7f611edb79fdc971d"}
Jul 30 17:05:20.029893 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:20.029870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-d9zfn" event={"ID":"53120c63-3815-4554-87fe-e3e327f87d7b","Type":"ContainerStarted","Data":"23064cb89863886be00eb0e2331f5705cf86dd687ddd338d12bed1695f8aebc5"}
Jul 30 17:05:22.043015 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:22.042936    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-2hwnr" event={"ID":"401ef632-8620-49d8-85eb-0cf85282e227","Type":"ContainerStarted","Data":"336aa063f6bc4624ccd3d1889c3fe455c210b825d4c96db866c22e7dc7e188a1"}
Jul 30 17:05:22.043518 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:22.043276    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-2hwnr"
Jul 30 17:05:22.061812 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:22.061753    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-2hwnr" podStartSLOduration=1.496769681 podStartE2EDuration="3.061731471s" totalImagesPullingTime="1.56496179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:05:22.061154155 +0000 UTC m=+298.790766677" watchObservedRunningTime="2026-07-30 17:05:22.061731471 +0000 UTC m=+298.791343972"
Jul 30 17:05:23.703669 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:23.703641    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:05:23.704340 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:23.704316    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:05:23.728593 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:23.728541    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 17:05:24.056224 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:24.056182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-d9zfn" event={"ID":"53120c63-3815-4554-87fe-e3e327f87d7b","Type":"ContainerStarted","Data":"274e2b1f8a2cbce328198e74280799d9bb436a0038e2acc25bce54261179a3df"}
Jul 30 17:05:24.058529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:24.056254    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:05:24.058529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:24.057576    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc" event={"ID":"9bf9d49e-2506-45da-818d-58adb14f9a0c","Type":"ContainerStarted","Data":"656c60967dc6614c4ee3c81d80f96e06aa61c4b4f56fa6591a8d1fde9b373d1a"}
Jul 30 17:05:24.058529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:24.057682    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:24.073637 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:24.073584    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-d9zfn" podStartSLOduration=1.936693947 podStartE2EDuration="6.073569287s" totalImagesPullingTime="4.13687534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:05:24.071087391 +0000 UTC m=+300.800699889" watchObservedRunningTime="2026-07-30 17:05:24.073569287 +0000 UTC m=+300.803181785"
Jul 30 17:05:24.087247 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:24.087190    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc" podStartSLOduration=2.387383047 podStartE2EDuration="6.087176093s" totalImagesPullingTime="3.699793046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:05:24.086023983 +0000 UTC m=+300.815636505" watchObservedRunningTime="2026-07-30 17:05:24.087176093 +0000 UTC m=+300.816788627"
Jul 30 17:05:35.067018 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:35.066985    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bl2rc"
Jul 30 17:05:39.025399 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:39.025365    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-rzhvx"
Jul 30 17:05:43.053411 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:43.053376    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-2hwnr"
Jul 30 17:05:45.064560 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:05:45.064512    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-d9zfn"
Jul 30 17:06:36.232288 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.232254    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-8677446b84-fnglq"]
Jul 30 17:06:36.235724 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.235680    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:06:36.238841 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.238820    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-js68t"]
Jul 30 17:06:36.239477 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.239455    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 30 17:06:36.239596 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.239465    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 30 17:06:36.240091 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.240076    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 30 17:06:36.240175 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.240077    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-5sh8f\""
Jul 30 17:06:36.242139 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.242123    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-js68t"
Jul 30 17:06:36.244505 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.244488    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-2lg9j\""
Jul 30 17:06:36.244616 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.244490    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 30 17:06:36.250561 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.250517    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-8677446b84-fnglq"]
Jul 30 17:06:36.254195 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.254177    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-js68t"]
Jul 30 17:06:36.416538 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.416511    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p4g5\" (UniqueName: \"kubernetes.io/projected/0df67def-f19a-4836-b331-af8adb02cfe3-kube-api-access-6p4g5\") pod \"kserve-controller-manager-8677446b84-fnglq\" (UID: \"0df67def-f19a-4836-b331-af8adb02cfe3\") " pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:06:36.416538 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.416558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0df67def-f19a-4836-b331-af8adb02cfe3-cert\") pod \"kserve-controller-manager-8677446b84-fnglq\" (UID: \"0df67def-f19a-4836-b331-af8adb02cfe3\") " pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:06:36.416739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.416584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jckcp\" (UniqueName: \"kubernetes.io/projected/a1049d54-12e9-4e1b-b9ed-83ef963e6fca-kube-api-access-jckcp\") pod \"llmisvc-controller-manager-654c557856-js68t\" (UID: \"a1049d54-12e9-4e1b-b9ed-83ef963e6fca\") " pod="kserve/llmisvc-controller-manager-654c557856-js68t"
Jul 30 17:06:36.416739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.416671    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1049d54-12e9-4e1b-b9ed-83ef963e6fca-cert\") pod \"llmisvc-controller-manager-654c557856-js68t\" (UID: \"a1049d54-12e9-4e1b-b9ed-83ef963e6fca\") " pod="kserve/llmisvc-controller-manager-654c557856-js68t"
Jul 30 17:06:36.517445 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.517387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jckcp\" (UniqueName: \"kubernetes.io/projected/a1049d54-12e9-4e1b-b9ed-83ef963e6fca-kube-api-access-jckcp\") pod \"llmisvc-controller-manager-654c557856-js68t\" (UID: \"a1049d54-12e9-4e1b-b9ed-83ef963e6fca\") " pod="kserve/llmisvc-controller-manager-654c557856-js68t"
Jul 30 17:06:36.517445 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.517420    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1049d54-12e9-4e1b-b9ed-83ef963e6fca-cert\") pod \"llmisvc-controller-manager-654c557856-js68t\" (UID: \"a1049d54-12e9-4e1b-b9ed-83ef963e6fca\") " pod="kserve/llmisvc-controller-manager-654c557856-js68t"
Jul 30 17:06:36.517676 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.517458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p4g5\" (UniqueName: \"kubernetes.io/projected/0df67def-f19a-4836-b331-af8adb02cfe3-kube-api-access-6p4g5\") pod \"kserve-controller-manager-8677446b84-fnglq\" (UID: \"0df67def-f19a-4836-b331-af8adb02cfe3\") " pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:06:36.517676 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.517481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0df67def-f19a-4836-b331-af8adb02cfe3-cert\") pod \"kserve-controller-manager-8677446b84-fnglq\" (UID: \"0df67def-f19a-4836-b331-af8adb02cfe3\") " pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:06:36.517676 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:06:36.517587    2561 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 30 17:06:36.517676 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:06:36.517646    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0df67def-f19a-4836-b331-af8adb02cfe3-cert podName:0df67def-f19a-4836-b331-af8adb02cfe3 nodeName:}" failed. No retries permitted until 2026-07-30 17:06:37.017628631 +0000 UTC m=+373.747241108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0df67def-f19a-4836-b331-af8adb02cfe3-cert") pod "kserve-controller-manager-8677446b84-fnglq" (UID: "0df67def-f19a-4836-b331-af8adb02cfe3") : secret "kserve-webhook-server-cert" not found
Jul 30 17:06:36.520072 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.520049    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1049d54-12e9-4e1b-b9ed-83ef963e6fca-cert\") pod \"llmisvc-controller-manager-654c557856-js68t\" (UID: \"a1049d54-12e9-4e1b-b9ed-83ef963e6fca\") " pod="kserve/llmisvc-controller-manager-654c557856-js68t"
Jul 30 17:06:36.528174 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.528153    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jckcp\" (UniqueName: \"kubernetes.io/projected/a1049d54-12e9-4e1b-b9ed-83ef963e6fca-kube-api-access-jckcp\") pod \"llmisvc-controller-manager-654c557856-js68t\" (UID: \"a1049d54-12e9-4e1b-b9ed-83ef963e6fca\") " pod="kserve/llmisvc-controller-manager-654c557856-js68t"
Jul 30 17:06:36.528345 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.528325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p4g5\" (UniqueName: \"kubernetes.io/projected/0df67def-f19a-4836-b331-af8adb02cfe3-kube-api-access-6p4g5\") pod \"kserve-controller-manager-8677446b84-fnglq\" (UID: \"0df67def-f19a-4836-b331-af8adb02cfe3\") " pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:06:36.558248 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.558229    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-js68t"
Jul 30 17:06:36.704544 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.704516    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-js68t"]
Jul 30 17:06:36.707503 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:06:36.707475    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda1049d54_12e9_4e1b_b9ed_83ef963e6fca.slice/crio-bf4581013dde29adbc67f8ce761771dd299893923c57acc2f9f331c2fe4d3dad WatchSource:0}: Error finding container bf4581013dde29adbc67f8ce761771dd299893923c57acc2f9f331c2fe4d3dad: Status 404 returned error can't find the container with id bf4581013dde29adbc67f8ce761771dd299893923c57acc2f9f331c2fe4d3dad
Jul 30 17:06:36.708871 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:36.708855    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 17:06:37.021953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:37.021926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0df67def-f19a-4836-b331-af8adb02cfe3-cert\") pod \"kserve-controller-manager-8677446b84-fnglq\" (UID: \"0df67def-f19a-4836-b331-af8adb02cfe3\") " pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:06:37.024351 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:37.024333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0df67def-f19a-4836-b331-af8adb02cfe3-cert\") pod \"kserve-controller-manager-8677446b84-fnglq\" (UID: \"0df67def-f19a-4836-b331-af8adb02cfe3\") " pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:06:37.152291 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:37.152265    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:06:37.280467 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:37.280443    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-8677446b84-fnglq"]
Jul 30 17:06:37.282369 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:06:37.282341    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df67def_f19a_4836_b331_af8adb02cfe3.slice/crio-3c951909975d1994d51638f93341eaac7e21d130be006b3fd58e4e865375b367 WatchSource:0}: Error finding container 3c951909975d1994d51638f93341eaac7e21d130be006b3fd58e4e865375b367: Status 404 returned error can't find the container with id 3c951909975d1994d51638f93341eaac7e21d130be006b3fd58e4e865375b367
Jul 30 17:06:37.367425 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:37.367396    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-8677446b84-fnglq" event={"ID":"0df67def-f19a-4836-b331-af8adb02cfe3","Type":"ContainerStarted","Data":"3c951909975d1994d51638f93341eaac7e21d130be006b3fd58e4e865375b367"}
Jul 30 17:06:37.368393 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:37.368374    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-js68t" event={"ID":"a1049d54-12e9-4e1b-b9ed-83ef963e6fca","Type":"ContainerStarted","Data":"bf4581013dde29adbc67f8ce761771dd299893923c57acc2f9f331c2fe4d3dad"}
Jul 30 17:06:41.388951 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:41.388917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-8677446b84-fnglq" event={"ID":"0df67def-f19a-4836-b331-af8adb02cfe3","Type":"ContainerStarted","Data":"01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d"}
Jul 30 17:06:41.389413 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:41.388985    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:06:41.390488 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:41.390465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-js68t" event={"ID":"a1049d54-12e9-4e1b-b9ed-83ef963e6fca","Type":"ContainerStarted","Data":"2a2d150efbf8bb0b24f9e938cb2c060d3bfcdb50f3302265b66bf7940e11a7ad"}
Jul 30 17:06:41.390622 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:41.390517    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-js68t"
Jul 30 17:06:41.404765 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:41.404723    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-8677446b84-fnglq" podStartSLOduration=1.867944539 podStartE2EDuration="5.404710971s" totalImagesPullingTime="3.536766432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:06:41.404154772 +0000 UTC m=+378.133767271" watchObservedRunningTime="2026-07-30 17:06:41.404710971 +0000 UTC m=+378.134323468"
Jul 30 17:06:41.420296 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:06:41.420259    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-js68t" podStartSLOduration=1.3147439269999999 podStartE2EDuration="5.420248503s" totalImagesPullingTime="4.105504576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:06:41.418700375 +0000 UTC m=+378.148312873" watchObservedRunningTime="2026-07-30 17:06:41.420248503 +0000 UTC m=+378.149861000"
Jul 30 17:07:12.396431 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:12.396402    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-js68t"
Jul 30 17:07:12.399509 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:12.399492    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:07:19.624005 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.623972    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-8677446b84-fnglq"]
Jul 30 17:07:19.624499 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.624171    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-8677446b84-fnglq" podUID="0df67def-f19a-4836-b331-af8adb02cfe3" containerName="manager" containerID="cri-o://01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d" gracePeriod=10
Jul 30 17:07:19.649528 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.649506    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-8677446b84-mx9rl"]
Jul 30 17:07:19.652748 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.652733    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-8677446b84-mx9rl"
Jul 30 17:07:19.660190 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.660169    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-8677446b84-mx9rl"]
Jul 30 17:07:19.737529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.737498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rbfb\" (UniqueName: \"kubernetes.io/projected/47c0a714-a4e8-4a4b-82ff-df16d1a5b6be-kube-api-access-4rbfb\") pod \"kserve-controller-manager-8677446b84-mx9rl\" (UID: \"47c0a714-a4e8-4a4b-82ff-df16d1a5b6be\") " pod="kserve/kserve-controller-manager-8677446b84-mx9rl"
Jul 30 17:07:19.737661 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.737535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47c0a714-a4e8-4a4b-82ff-df16d1a5b6be-cert\") pod \"kserve-controller-manager-8677446b84-mx9rl\" (UID: \"47c0a714-a4e8-4a4b-82ff-df16d1a5b6be\") " pod="kserve/kserve-controller-manager-8677446b84-mx9rl"
Jul 30 17:07:19.838701 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.838673    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rbfb\" (UniqueName: \"kubernetes.io/projected/47c0a714-a4e8-4a4b-82ff-df16d1a5b6be-kube-api-access-4rbfb\") pod \"kserve-controller-manager-8677446b84-mx9rl\" (UID: \"47c0a714-a4e8-4a4b-82ff-df16d1a5b6be\") " pod="kserve/kserve-controller-manager-8677446b84-mx9rl"
Jul 30 17:07:19.838851 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.838706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47c0a714-a4e8-4a4b-82ff-df16d1a5b6be-cert\") pod \"kserve-controller-manager-8677446b84-mx9rl\" (UID: \"47c0a714-a4e8-4a4b-82ff-df16d1a5b6be\") " pod="kserve/kserve-controller-manager-8677446b84-mx9rl"
Jul 30 17:07:19.841025 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.840997    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47c0a714-a4e8-4a4b-82ff-df16d1a5b6be-cert\") pod \"kserve-controller-manager-8677446b84-mx9rl\" (UID: \"47c0a714-a4e8-4a4b-82ff-df16d1a5b6be\") " pod="kserve/kserve-controller-manager-8677446b84-mx9rl"
Jul 30 17:07:19.847011 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.846984    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rbfb\" (UniqueName: \"kubernetes.io/projected/47c0a714-a4e8-4a4b-82ff-df16d1a5b6be-kube-api-access-4rbfb\") pod \"kserve-controller-manager-8677446b84-mx9rl\" (UID: \"47c0a714-a4e8-4a4b-82ff-df16d1a5b6be\") " pod="kserve/kserve-controller-manager-8677446b84-mx9rl"
Jul 30 17:07:19.866757 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.866738    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:07:19.939747 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.939687    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p4g5\" (UniqueName: \"kubernetes.io/projected/0df67def-f19a-4836-b331-af8adb02cfe3-kube-api-access-6p4g5\") pod \"0df67def-f19a-4836-b331-af8adb02cfe3\" (UID: \"0df67def-f19a-4836-b331-af8adb02cfe3\") "
Jul 30 17:07:19.939747 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.939724    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0df67def-f19a-4836-b331-af8adb02cfe3-cert\") pod \"0df67def-f19a-4836-b331-af8adb02cfe3\" (UID: \"0df67def-f19a-4836-b331-af8adb02cfe3\") "
Jul 30 17:07:19.941788 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.941761    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df67def-f19a-4836-b331-af8adb02cfe3-cert" (OuterVolumeSpecName: "cert") pod "0df67def-f19a-4836-b331-af8adb02cfe3" (UID: "0df67def-f19a-4836-b331-af8adb02cfe3"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:07:19.941888 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.941793    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df67def-f19a-4836-b331-af8adb02cfe3-kube-api-access-6p4g5" (OuterVolumeSpecName: "kube-api-access-6p4g5") pod "0df67def-f19a-4836-b331-af8adb02cfe3" (UID: "0df67def-f19a-4836-b331-af8adb02cfe3"). InnerVolumeSpecName "kube-api-access-6p4g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:07:19.998206 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:19.998181    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-8677446b84-mx9rl"
Jul 30 17:07:20.041234 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.041211    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p4g5\" (UniqueName: \"kubernetes.io/projected/0df67def-f19a-4836-b331-af8adb02cfe3-kube-api-access-6p4g5\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:07:20.041234 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.041235    2561 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0df67def-f19a-4836-b331-af8adb02cfe3-cert\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:07:20.119405 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.119377    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-8677446b84-mx9rl"]
Jul 30 17:07:20.121629 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:07:20.121604    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c0a714_a4e8_4a4b_82ff_df16d1a5b6be.slice/crio-0d0baceaf020f7c86a17379fc0e7a2b8f428419d98a7af43dc8c2224cf796e9f WatchSource:0}: Error finding container 0d0baceaf020f7c86a17379fc0e7a2b8f428419d98a7af43dc8c2224cf796e9f: Status 404 returned error can't find the container with id 0d0baceaf020f7c86a17379fc0e7a2b8f428419d98a7af43dc8c2224cf796e9f
Jul 30 17:07:20.552300 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.552271    2561 generic.go:356] "Generic (PLEG): container finished" podID="0df67def-f19a-4836-b331-af8adb02cfe3" containerID="01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d" exitCode=0
Jul 30 17:07:20.552438 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.552321    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-8677446b84-fnglq"
Jul 30 17:07:20.552438 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.552355    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-8677446b84-fnglq" event={"ID":"0df67def-f19a-4836-b331-af8adb02cfe3","Type":"ContainerDied","Data":"01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d"}
Jul 30 17:07:20.552438 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.552416    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-8677446b84-fnglq" event={"ID":"0df67def-f19a-4836-b331-af8adb02cfe3","Type":"ContainerDied","Data":"3c951909975d1994d51638f93341eaac7e21d130be006b3fd58e4e865375b367"}
Jul 30 17:07:20.552601 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.552446    2561 scope.go:117] "RemoveContainer" containerID="01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d"
Jul 30 17:07:20.553494 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.553394    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-8677446b84-mx9rl" event={"ID":"47c0a714-a4e8-4a4b-82ff-df16d1a5b6be","Type":"ContainerStarted","Data":"0d0baceaf020f7c86a17379fc0e7a2b8f428419d98a7af43dc8c2224cf796e9f"}
Jul 30 17:07:20.560984 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.560970    2561 scope.go:117] "RemoveContainer" containerID="01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d"
Jul 30 17:07:20.561210 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:07:20.561194    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d\": container with ID starting with 01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d not found: ID does not exist" containerID="01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d"
Jul 30 17:07:20.561248 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.561221    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d"} err="failed to get container status \"01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d\": rpc error: code = NotFound desc = could not find container \"01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d\": container with ID starting with 01a9c7fd0eab225a10f1c2967e02c0cb076adf9e05d2a67a76b53d2eabc75f6d not found: ID does not exist"
Jul 30 17:07:20.574430 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.574411    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-8677446b84-fnglq"]
Jul 30 17:07:20.578022 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:20.578005    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-8677446b84-fnglq"]
Jul 30 17:07:21.559896 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:21.559862    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-8677446b84-mx9rl" event={"ID":"47c0a714-a4e8-4a4b-82ff-df16d1a5b6be","Type":"ContainerStarted","Data":"e365d8b733eec68da2681a7ace4d5aa040e4427ed6d72825a85b95a1d78b132a"}
Jul 30 17:07:21.560358 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:21.559986    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-8677446b84-mx9rl"
Jul 30 17:07:21.575539 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:21.575489    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-8677446b84-mx9rl" podStartSLOduration=2.068916463 podStartE2EDuration="2.575474494s" totalImagesPullingTime="506.558031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:07:21.574966914 +0000 UTC m=+418.304579423" watchObservedRunningTime="2026-07-30 17:07:21.575474494 +0000 UTC m=+418.305086992"
Jul 30 17:07:21.800826 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:21.800800    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0df67def-f19a-4836-b331-af8adb02cfe3" path="/var/lib/kubelet/pods/0df67def-f19a-4836-b331-af8adb02cfe3/volumes"
Jul 30 17:07:40.487966 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:40.487926    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-998dd449b-5t46k"]
Jul 30 17:07:52.569589 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:07:52.569491    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-8677446b84-mx9rl"
Jul 30 17:08:05.514250 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.514212    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-998dd449b-5t46k" podUID="c38be431-072d-4d2f-a254-01149c0c42e6" containerName="console" containerID="cri-o://3972ebda3f46b61cc91379df8df4ea7dc607663807f377e054506242afdc60b2" gracePeriod=15
Jul 30 17:08:05.744438 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.744408    2561 generic.go:356] "Generic (PLEG): container finished" podID="c38be431-072d-4d2f-a254-01149c0c42e6" containerID="3972ebda3f46b61cc91379df8df4ea7dc607663807f377e054506242afdc60b2" exitCode=0
Jul 30 17:08:05.744539 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.744498    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998dd449b-5t46k" event={"ID":"c38be431-072d-4d2f-a254-01149c0c42e6","Type":"ContainerDied","Data":"3972ebda3f46b61cc91379df8df4ea7dc607663807f377e054506242afdc60b2"}
Jul 30 17:08:05.744631 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.744577    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998dd449b-5t46k" event={"ID":"c38be431-072d-4d2f-a254-01149c0c42e6","Type":"ContainerDied","Data":"1caa79e0b6b8da6da445593b908b1ee1a2dc1ee7a5059908a2676c681991d9f9"}
Jul 30 17:08:05.744631 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.744602    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1caa79e0b6b8da6da445593b908b1ee1a2dc1ee7a5059908a2676c681991d9f9"
Jul 30 17:08:05.757220 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.757200    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:08:05.894785 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.894708    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-oauth-config\") pod \"c38be431-072d-4d2f-a254-01149c0c42e6\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") "
Jul 30 17:08:05.894785 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.894757    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-trusted-ca-bundle\") pod \"c38be431-072d-4d2f-a254-01149c0c42e6\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") "
Jul 30 17:08:05.894993 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.894792    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-serving-cert\") pod \"c38be431-072d-4d2f-a254-01149c0c42e6\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") "
Jul 30 17:08:05.894993 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.894899    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-service-ca\") pod \"c38be431-072d-4d2f-a254-01149c0c42e6\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") "
Jul 30 17:08:05.894993 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.894937    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-console-config\") pod \"c38be431-072d-4d2f-a254-01149c0c42e6\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") "
Jul 30 17:08:05.894993 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.894970    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-oauth-serving-cert\") pod \"c38be431-072d-4d2f-a254-01149c0c42e6\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") "
Jul 30 17:08:05.895207 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.895142    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl5zm\" (UniqueName: \"kubernetes.io/projected/c38be431-072d-4d2f-a254-01149c0c42e6-kube-api-access-sl5zm\") pod \"c38be431-072d-4d2f-a254-01149c0c42e6\" (UID: \"c38be431-072d-4d2f-a254-01149c0c42e6\") "
Jul 30 17:08:05.895296 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.895267    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c38be431-072d-4d2f-a254-01149c0c42e6" (UID: "c38be431-072d-4d2f-a254-01149c0c42e6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:08:05.895532 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.895276    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-service-ca" (OuterVolumeSpecName: "service-ca") pod "c38be431-072d-4d2f-a254-01149c0c42e6" (UID: "c38be431-072d-4d2f-a254-01149c0c42e6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:08:05.895749 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.895291    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-console-config" (OuterVolumeSpecName: "console-config") pod "c38be431-072d-4d2f-a254-01149c0c42e6" (UID: "c38be431-072d-4d2f-a254-01149c0c42e6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:08:05.895749 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.895300    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c38be431-072d-4d2f-a254-01149c0c42e6" (UID: "c38be431-072d-4d2f-a254-01149c0c42e6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:08:05.897072 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.897045    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c38be431-072d-4d2f-a254-01149c0c42e6" (UID: "c38be431-072d-4d2f-a254-01149c0c42e6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:08:05.897072 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.897060    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c38be431-072d-4d2f-a254-01149c0c42e6" (UID: "c38be431-072d-4d2f-a254-01149c0c42e6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:08:05.897268 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.897253    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c38be431-072d-4d2f-a254-01149c0c42e6-kube-api-access-sl5zm" (OuterVolumeSpecName: "kube-api-access-sl5zm") pod "c38be431-072d-4d2f-a254-01149c0c42e6" (UID: "c38be431-072d-4d2f-a254-01149c0c42e6"). InnerVolumeSpecName "kube-api-access-sl5zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:08:05.996235 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.996203    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-trusted-ca-bundle\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:08:05.996235 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.996233    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-serving-cert\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:08:05.996235 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.996242    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-service-ca\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:08:05.996389 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.996250    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-console-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:08:05.996389 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.996258    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38be431-072d-4d2f-a254-01149c0c42e6-oauth-serving-cert\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:08:05.996389 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.996266    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl5zm\" (UniqueName: \"kubernetes.io/projected/c38be431-072d-4d2f-a254-01149c0c42e6-kube-api-access-sl5zm\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:08:05.996389 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:05.996275    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38be431-072d-4d2f-a254-01149c0c42e6-console-oauth-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:08:06.748822 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:06.748789    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998dd449b-5t46k"
Jul 30 17:08:06.769343 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:06.769318    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-998dd449b-5t46k"]
Jul 30 17:08:06.772515 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:06.772494    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-998dd449b-5t46k"]
Jul 30 17:08:07.800440 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:08:07.800409    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c38be431-072d-4d2f-a254-01149c0c42e6" path="/var/lib/kubelet/pods/c38be431-072d-4d2f-a254-01149c0c42e6/volumes"
Jul 30 17:09:42.962262 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.962222    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"]
Jul 30 17:09:42.962866 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.962591    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df67def-f19a-4836-b331-af8adb02cfe3" containerName="manager"
Jul 30 17:09:42.962866 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.962604    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df67def-f19a-4836-b331-af8adb02cfe3" containerName="manager"
Jul 30 17:09:42.962866 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.962615    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c38be431-072d-4d2f-a254-01149c0c42e6" containerName="console"
Jul 30 17:09:42.962866 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.962620    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c38be431-072d-4d2f-a254-01149c0c42e6" containerName="console"
Jul 30 17:09:42.962866 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.962667    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c38be431-072d-4d2f-a254-01149c0c42e6" containerName="console"
Jul 30 17:09:42.962866 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.962676    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df67def-f19a-4836-b331-af8adb02cfe3" containerName="manager"
Jul 30 17:09:42.965712 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.965693    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:42.968360 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.968337    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-74452-kube-rbac-proxy-sar-config\""
Jul 30 17:09:42.968484 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.968473    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-74452-predictor-serving-cert\""
Jul 30 17:09:42.968582 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.968437    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 30 17:09:42.968582 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.968386    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 30 17:09:42.969418 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.969399    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-qvl2g\""
Jul 30 17:09:42.975724 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:42.975704    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"]
Jul 30 17:09:43.052501 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:43.052469    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9rh\" (UniqueName: \"kubernetes.io/projected/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-api-access-bs9rh\") pod \"error-404-isvc-74452-predictor-8655c49fcb-k2k6d\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") " pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:43.052686 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:43.052510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-74452-predictor-8655c49fcb-k2k6d\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") " pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:43.052686 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:43.052578    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-proxy-tls\") pod \"error-404-isvc-74452-predictor-8655c49fcb-k2k6d\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") " pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:43.153810 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:43.153773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9rh\" (UniqueName: \"kubernetes.io/projected/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-api-access-bs9rh\") pod \"error-404-isvc-74452-predictor-8655c49fcb-k2k6d\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") " pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:43.154002 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:43.153862    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-74452-predictor-8655c49fcb-k2k6d\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") " pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:43.154002 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:43.153891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-proxy-tls\") pod \"error-404-isvc-74452-predictor-8655c49fcb-k2k6d\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") " pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:43.154540 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:43.154508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-74452-predictor-8655c49fcb-k2k6d\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") " pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:43.156761 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:43.156736    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-proxy-tls\") pod \"error-404-isvc-74452-predictor-8655c49fcb-k2k6d\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") " pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:43.162582 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:43.162539    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9rh\" (UniqueName: \"kubernetes.io/projected/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-api-access-bs9rh\") pod \"error-404-isvc-74452-predictor-8655c49fcb-k2k6d\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") " pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:43.277617 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:43.277503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:43.420427 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:43.420394    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"]
Jul 30 17:09:43.423503 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:09:43.423469    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe140f3c_8f27_4fc9_b79e_a70615c86ecf.slice/crio-d1901ea4a11b755e741ef88ad681ff1f0bf4700f74e301746a81504d919b1590 WatchSource:0}: Error finding container d1901ea4a11b755e741ef88ad681ff1f0bf4700f74e301746a81504d919b1590: Status 404 returned error can't find the container with id d1901ea4a11b755e741ef88ad681ff1f0bf4700f74e301746a81504d919b1590
Jul 30 17:09:44.174012 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:44.173875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" event={"ID":"fe140f3c-8f27-4fc9-b79e-a70615c86ecf","Type":"ContainerStarted","Data":"d1901ea4a11b755e741ef88ad681ff1f0bf4700f74e301746a81504d919b1590"}
Jul 30 17:09:56.240198 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:56.240160    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" event={"ID":"fe140f3c-8f27-4fc9-b79e-a70615c86ecf","Type":"ContainerStarted","Data":"2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa"}
Jul 30 17:09:59.256855 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:59.256819    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" event={"ID":"fe140f3c-8f27-4fc9-b79e-a70615c86ecf","Type":"ContainerStarted","Data":"1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c"}
Jul 30 17:09:59.257339 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:59.256889    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:09:59.278511 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:09:59.278442    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" podStartSLOduration=2.314858529 podStartE2EDuration="17.278425241s" totalImagesPullingTime="14.963566712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:09:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:09:59.27725112 +0000 UTC m=+576.006863619" watchObservedRunningTime="2026-07-30 17:09:59.278425241 +0000 UTC m=+576.008037794"
Jul 30 17:10:00.261839 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:00.261794    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:10:00.263308 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:00.263275    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 30 17:10:01.265962 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:01.265919    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 30 17:10:06.270587 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:06.270532    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:10:06.271158 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:06.271126    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 30 17:10:16.271568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:16.271510    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 30 17:10:23.744941 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:23.744860    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:10:23.747135 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:23.746324    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:10:23.760052 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:23.760027    2561 scope.go:117] "RemoveContainer" containerID="3972ebda3f46b61cc91379df8df4ea7dc607663807f377e054506242afdc60b2"
Jul 30 17:10:26.271615 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:26.271572    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 30 17:10:36.271645 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:36.271609    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Jul 30 17:10:46.272330 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:10:46.272252    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:11:16.953954 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:16.953924    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"]
Jul 30 17:11:16.954780 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:16.954166    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kserve-container" containerID="cri-o://2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa" gracePeriod=30
Jul 30 17:11:16.954780 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:16.954509    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kube-rbac-proxy" containerID="cri-o://1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c" gracePeriod=30
Jul 30 17:11:16.982400 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:16.982365    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"]
Jul 30 17:11:16.985845 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:16.985826    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:16.988622 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:16.988593    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-8bf5c-predictor-serving-cert\""
Jul 30 17:11:16.988789 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:16.988648    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-8bf5c-kube-rbac-proxy-sar-config\""
Jul 30 17:11:16.994719 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:16.994698    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"]
Jul 30 17:11:17.163354 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.163323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be04216f-8163-4236-af02-3518757f6ec2-proxy-tls\") pod \"error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") " pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:17.163537 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.163370    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be04216f-8163-4236-af02-3518757f6ec2-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") " pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:17.163537 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.163444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dx7d\" (UniqueName: \"kubernetes.io/projected/be04216f-8163-4236-af02-3518757f6ec2-kube-api-access-8dx7d\") pod \"error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") " pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:17.264786 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.264705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be04216f-8163-4236-af02-3518757f6ec2-proxy-tls\") pod \"error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") " pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:17.264786 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.264750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be04216f-8163-4236-af02-3518757f6ec2-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") " pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:17.264958 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.264790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dx7d\" (UniqueName: \"kubernetes.io/projected/be04216f-8163-4236-af02-3518757f6ec2-kube-api-access-8dx7d\") pod \"error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") " pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:17.265458 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.265438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be04216f-8163-4236-af02-3518757f6ec2-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") " pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:17.267314 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.267280    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be04216f-8163-4236-af02-3518757f6ec2-proxy-tls\") pod \"error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") " pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:17.273801 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.273781    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dx7d\" (UniqueName: \"kubernetes.io/projected/be04216f-8163-4236-af02-3518757f6ec2-kube-api-access-8dx7d\") pod \"error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") " pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:17.298598 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.298572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:17.431766 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.431743    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"]
Jul 30 17:11:17.434405 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:11:17.434373    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe04216f_8163_4236_af02_3518757f6ec2.slice/crio-2e2b9fdd4d467ce10d2d6a38c900403388e5ab9b60b80a5d2f17c70d2563fd75 WatchSource:0}: Error finding container 2e2b9fdd4d467ce10d2d6a38c900403388e5ab9b60b80a5d2f17c70d2563fd75: Status 404 returned error can't find the container with id 2e2b9fdd4d467ce10d2d6a38c900403388e5ab9b60b80a5d2f17c70d2563fd75
Jul 30 17:11:17.604441 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.604404    2561 generic.go:356] "Generic (PLEG): container finished" podID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerID="1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c" exitCode=2
Jul 30 17:11:17.604629 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.604473    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" event={"ID":"fe140f3c-8f27-4fc9-b79e-a70615c86ecf","Type":"ContainerDied","Data":"1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c"}
Jul 30 17:11:17.606113 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.606087    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" event={"ID":"be04216f-8163-4236-af02-3518757f6ec2","Type":"ContainerStarted","Data":"3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646"}
Jul 30 17:11:17.606219 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.606138    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" event={"ID":"be04216f-8163-4236-af02-3518757f6ec2","Type":"ContainerStarted","Data":"5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36"}
Jul 30 17:11:17.606219 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.606171    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" event={"ID":"be04216f-8163-4236-af02-3518757f6ec2","Type":"ContainerStarted","Data":"2e2b9fdd4d467ce10d2d6a38c900403388e5ab9b60b80a5d2f17c70d2563fd75"}
Jul 30 17:11:17.606344 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.606328    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:17.624090 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:17.623922    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" podStartSLOduration=1.6239056619999999 podStartE2EDuration="1.623905662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:11:17.623677978 +0000 UTC m=+654.353290496" watchObservedRunningTime="2026-07-30 17:11:17.623905662 +0000 UTC m=+654.353518161"
Jul 30 17:11:18.611017 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:18.610987    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:18.612753 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:18.612724    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 30 17:11:19.615565 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:19.615517    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 30 17:11:21.266679 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:21.266637    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.32:8643/healthz\": dial tcp 10.132.0.32:8643: connect: connection refused"
Jul 30 17:11:23.605640 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.605614    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:11:23.613907 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.613887    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs9rh\" (UniqueName: \"kubernetes.io/projected/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-api-access-bs9rh\") pod \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") "
Jul 30 17:11:23.614039 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.613939    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-rbac-proxy-sar-config\") pod \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") "
Jul 30 17:11:23.614039 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.613978    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-proxy-tls\") pod \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\" (UID: \"fe140f3c-8f27-4fc9-b79e-a70615c86ecf\") "
Jul 30 17:11:23.614280 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.614259    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "fe140f3c-8f27-4fc9-b79e-a70615c86ecf" (UID: "fe140f3c-8f27-4fc9-b79e-a70615c86ecf"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:11:23.616133 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.616110    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-api-access-bs9rh" (OuterVolumeSpecName: "kube-api-access-bs9rh") pod "fe140f3c-8f27-4fc9-b79e-a70615c86ecf" (UID: "fe140f3c-8f27-4fc9-b79e-a70615c86ecf"). InnerVolumeSpecName "kube-api-access-bs9rh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:11:23.616204 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.616188    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fe140f3c-8f27-4fc9-b79e-a70615c86ecf" (UID: "fe140f3c-8f27-4fc9-b79e-a70615c86ecf"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:11:23.633188 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.633122    2561 generic.go:356] "Generic (PLEG): container finished" podID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerID="2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa" exitCode=0
Jul 30 17:11:23.633188 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.633181    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"
Jul 30 17:11:23.633356 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.633201    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" event={"ID":"fe140f3c-8f27-4fc9-b79e-a70615c86ecf","Type":"ContainerDied","Data":"2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa"}
Jul 30 17:11:23.633356 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.633261    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d" event={"ID":"fe140f3c-8f27-4fc9-b79e-a70615c86ecf","Type":"ContainerDied","Data":"d1901ea4a11b755e741ef88ad681ff1f0bf4700f74e301746a81504d919b1590"}
Jul 30 17:11:23.633356 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.633289    2561 scope.go:117] "RemoveContainer" containerID="1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c"
Jul 30 17:11:23.642467 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.642449    2561 scope.go:117] "RemoveContainer" containerID="2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa"
Jul 30 17:11:23.651298 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.651258    2561 scope.go:117] "RemoveContainer" containerID="1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c"
Jul 30 17:11:23.652519 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:11:23.652007    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c\": container with ID starting with 1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c not found: ID does not exist" containerID="1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c"
Jul 30 17:11:23.652519 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.652063    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c"} err="failed to get container status \"1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c\": rpc error: code = NotFound desc = could not find container \"1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c\": container with ID starting with 1eec8ea22c6002bc60cbad5f43e65ca15f1115090494e26c5fb72be620a9794c not found: ID does not exist"
Jul 30 17:11:23.652519 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.652101    2561 scope.go:117] "RemoveContainer" containerID="2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa"
Jul 30 17:11:23.652519 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:11:23.652421    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa\": container with ID starting with 2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa not found: ID does not exist" containerID="2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa"
Jul 30 17:11:23.652519 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.652458    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa"} err="failed to get container status \"2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa\": rpc error: code = NotFound desc = could not find container \"2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa\": container with ID starting with 2005c991bffb4299c3065a153cb268fdbd055218c3a165fa3b69720c0a0010fa not found: ID does not exist"
Jul 30 17:11:23.660604 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.660575    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"]
Jul 30 17:11:23.661870 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.661853    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74452-predictor-8655c49fcb-k2k6d"]
Jul 30 17:11:23.714391 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.714369    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs9rh\" (UniqueName: \"kubernetes.io/projected/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-api-access-bs9rh\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:11:23.714391 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.714388    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:11:23.714564 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.714398    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fe140f3c-8f27-4fc9-b79e-a70615c86ecf-proxy-tls\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:11:23.800767 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:23.800741    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" path="/var/lib/kubelet/pods/fe140f3c-8f27-4fc9-b79e-a70615c86ecf/volumes"
Jul 30 17:11:24.620157 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:24.620129    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:11:24.620622 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:24.620596    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 30 17:11:34.621507 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:34.621468    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 30 17:11:44.620794 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:44.620746    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 30 17:11:54.620572 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:11:54.620522    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 30 17:12:04.621734 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:04.621702    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:12:13.039995 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.039961    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"]
Jul 30 17:12:13.040422 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.040308    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kserve-container"
Jul 30 17:12:13.040422 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.040324    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kserve-container"
Jul 30 17:12:13.040422 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.040334    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kube-rbac-proxy"
Jul 30 17:12:13.040422 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.040340    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kube-rbac-proxy"
Jul 30 17:12:13.040422 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.040399    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kserve-container"
Jul 30 17:12:13.040422 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.040406    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe140f3c-8f27-4fc9-b79e-a70615c86ecf" containerName="kube-rbac-proxy"
Jul 30 17:12:13.043633 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.043618    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:13.046062 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.046029    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-9ae38-predictor-serving-cert\""
Jul 30 17:12:13.046193 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.046039    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-9ae38-kube-rbac-proxy-sar-config\""
Jul 30 17:12:13.053489 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.053460    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"]
Jul 30 17:12:13.179635 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.179607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/97c5295d-ffa3-42b0-85e0-2fadca336069-proxy-tls\") pod \"error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") " pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:13.179635 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.179645    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") " pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:13.179814 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.179714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wktv2\" (UniqueName: \"kubernetes.io/projected/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-api-access-wktv2\") pod \"error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") " pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:13.280542 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.280513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/97c5295d-ffa3-42b0-85e0-2fadca336069-proxy-tls\") pod \"error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") " pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:13.280696 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.280594    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") " pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:13.280696 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:12:13.280654    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-serving-cert: secret "error-404-isvc-9ae38-predictor-serving-cert" not found
Jul 30 17:12:13.280696 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.280649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wktv2\" (UniqueName: \"kubernetes.io/projected/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-api-access-wktv2\") pod \"error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") " pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:13.280823 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:12:13.280731    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c5295d-ffa3-42b0-85e0-2fadca336069-proxy-tls podName:97c5295d-ffa3-42b0-85e0-2fadca336069 nodeName:}" failed. No retries permitted until 2026-07-30 17:12:13.78070892 +0000 UTC m=+710.510321397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/97c5295d-ffa3-42b0-85e0-2fadca336069-proxy-tls") pod "error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" (UID: "97c5295d-ffa3-42b0-85e0-2fadca336069") : secret "error-404-isvc-9ae38-predictor-serving-cert" not found
Jul 30 17:12:13.281279 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.281262    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") " pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:13.289498 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.289476    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wktv2\" (UniqueName: \"kubernetes.io/projected/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-api-access-wktv2\") pod \"error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") " pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:13.784130 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.784097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/97c5295d-ffa3-42b0-85e0-2fadca336069-proxy-tls\") pod \"error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") " pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:13.786592 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.786568    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/97c5295d-ffa3-42b0-85e0-2fadca336069-proxy-tls\") pod \"error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") " pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:13.956371 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:13.956345    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:14.081397 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:14.081368    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"]
Jul 30 17:12:14.083059 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:12:14.083026    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c5295d_ffa3_42b0_85e0_2fadca336069.slice/crio-287c10d728e990472aacfbc6dcbfdbe8f705f6195714fd624e4e49854e8e6158 WatchSource:0}: Error finding container 287c10d728e990472aacfbc6dcbfdbe8f705f6195714fd624e4e49854e8e6158: Status 404 returned error can't find the container with id 287c10d728e990472aacfbc6dcbfdbe8f705f6195714fd624e4e49854e8e6158
Jul 30 17:12:14.861328 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:14.861236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" event={"ID":"97c5295d-ffa3-42b0-85e0-2fadca336069","Type":"ContainerStarted","Data":"d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92"}
Jul 30 17:12:14.861328 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:14.861302    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:14.861529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:14.861336    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:14.861529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:14.861355    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" event={"ID":"97c5295d-ffa3-42b0-85e0-2fadca336069","Type":"ContainerStarted","Data":"724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112"}
Jul 30 17:12:14.861529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:14.861377    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" event={"ID":"97c5295d-ffa3-42b0-85e0-2fadca336069","Type":"ContainerStarted","Data":"287c10d728e990472aacfbc6dcbfdbe8f705f6195714fd624e4e49854e8e6158"}
Jul 30 17:12:14.862591 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:14.862536    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Jul 30 17:12:14.880203 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:14.880157    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" podStartSLOduration=1.88014057 podStartE2EDuration="1.88014057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:12:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:12:14.879961871 +0000 UTC m=+711.609574413" watchObservedRunningTime="2026-07-30 17:12:14.88014057 +0000 UTC m=+711.609753068"
Jul 30 17:12:15.874851 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:15.874813    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Jul 30 17:12:20.880716 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:20.880686    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:12:20.881161 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:20.881137    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Jul 30 17:12:30.881750 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:30.881702    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Jul 30 17:12:40.881124 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:40.881081    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Jul 30 17:12:50.881227 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:12:50.881177    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Jul 30 17:13:00.882378 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:13:00.882350    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:15:23.777116 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:15:23.777085    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:15:23.780937 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:15:23.780916    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:20:23.803214 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:23.803186    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:20:23.809888 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:23.809861    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:20:31.807899 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.807853    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"]
Jul 30 17:20:31.808331 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.808097    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kserve-container" containerID="cri-o://5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36" gracePeriod=30
Jul 30 17:20:31.808331 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.808142    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kube-rbac-proxy" containerID="cri-o://3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646" gracePeriod=30
Jul 30 17:20:31.901466 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.901431    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"]
Jul 30 17:20:31.905010 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.904988    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:31.907311 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.907279    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-c48ce-predictor-serving-cert\""
Jul 30 17:20:31.907498 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.907319    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-c48ce-kube-rbac-proxy-sar-config\""
Jul 30 17:20:31.914132 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.913859    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"]
Jul 30 17:20:31.977273 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.977238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhqhg\" (UniqueName: \"kubernetes.io/projected/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-api-access-rhqhg\") pod \"error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") " pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:31.977432 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.977308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-proxy-tls\") pod \"error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") " pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:31.977432 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.977342    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") " pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:31.989299 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.989268    2561 generic.go:356] "Generic (PLEG): container finished" podID="be04216f-8163-4236-af02-3518757f6ec2" containerID="3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646" exitCode=2
Jul 30 17:20:31.989429 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:31.989344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" event={"ID":"be04216f-8163-4236-af02-3518757f6ec2","Type":"ContainerDied","Data":"3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646"}
Jul 30 17:20:32.078628 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.078510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhqhg\" (UniqueName: \"kubernetes.io/projected/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-api-access-rhqhg\") pod \"error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") " pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:32.078628 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.078608    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-proxy-tls\") pod \"error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") " pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:32.078935 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.078640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") " pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:32.079435 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.079410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") " pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:32.081400 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.081373    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-proxy-tls\") pod \"error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") " pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:32.086596 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.086572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhqhg\" (UniqueName: \"kubernetes.io/projected/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-api-access-rhqhg\") pod \"error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") " pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:32.218191 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.218152    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:32.350239 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.350214    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"]
Jul 30 17:20:32.352237 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:20:32.352206    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd070e8e1_32d3_4bb4_8096_c4e84ec6e3c7.slice/crio-41bcab8366e0f94b1408b844f6d8a6e240f2ba158c4a8288f84d215745a33c55 WatchSource:0}: Error finding container 41bcab8366e0f94b1408b844f6d8a6e240f2ba158c4a8288f84d215745a33c55: Status 404 returned error can't find the container with id 41bcab8366e0f94b1408b844f6d8a6e240f2ba158c4a8288f84d215745a33c55
Jul 30 17:20:32.995577 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.995517    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" event={"ID":"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7","Type":"ContainerStarted","Data":"36484d7c04d0ef6e213b0979b54d2b00f80d4bf9ae5755d6bc271f9b0a406400"}
Jul 30 17:20:32.996023 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.995594    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" event={"ID":"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7","Type":"ContainerStarted","Data":"ea8716e3280014b435727cac927626e72445e14a361766dbf2e7dc1365cd37ac"}
Jul 30 17:20:32.996023 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.995618    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" event={"ID":"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7","Type":"ContainerStarted","Data":"41bcab8366e0f94b1408b844f6d8a6e240f2ba158c4a8288f84d215745a33c55"}
Jul 30 17:20:32.996023 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:32.995776    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:33.013113 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:33.013061    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" podStartSLOduration=2.013046307 podStartE2EDuration="2.013046307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:20:33.011675015 +0000 UTC m=+1209.741287539" watchObservedRunningTime="2026-07-30 17:20:33.013046307 +0000 UTC m=+1209.742658805"
Jul 30 17:20:34.005909 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:34.005875    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:34.007630 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:34.007595    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 30 17:20:34.616519 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:34.616476    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.33:8643/healthz\": dial tcp 10.132.0.33:8643: connect: connection refused"
Jul 30 17:20:34.620942 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:34.620914    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 30 17:20:35.010892 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:35.010854    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 30 17:20:35.163094 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:35.163072    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:20:35.305871 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:35.305778    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be04216f-8163-4236-af02-3518757f6ec2-proxy-tls\") pod \"be04216f-8163-4236-af02-3518757f6ec2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") "
Jul 30 17:20:35.305871 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:35.305826    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be04216f-8163-4236-af02-3518757f6ec2-kube-rbac-proxy-sar-config\") pod \"be04216f-8163-4236-af02-3518757f6ec2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") "
Jul 30 17:20:35.305871 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:35.305869    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dx7d\" (UniqueName: \"kubernetes.io/projected/be04216f-8163-4236-af02-3518757f6ec2-kube-api-access-8dx7d\") pod \"be04216f-8163-4236-af02-3518757f6ec2\" (UID: \"be04216f-8163-4236-af02-3518757f6ec2\") "
Jul 30 17:20:35.306284 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:35.306251    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be04216f-8163-4236-af02-3518757f6ec2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "be04216f-8163-4236-af02-3518757f6ec2" (UID: "be04216f-8163-4236-af02-3518757f6ec2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:20:35.308044 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:35.308014    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be04216f-8163-4236-af02-3518757f6ec2-kube-api-access-8dx7d" (OuterVolumeSpecName: "kube-api-access-8dx7d") pod "be04216f-8163-4236-af02-3518757f6ec2" (UID: "be04216f-8163-4236-af02-3518757f6ec2"). InnerVolumeSpecName "kube-api-access-8dx7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:20:35.308155 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:35.308098    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be04216f-8163-4236-af02-3518757f6ec2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "be04216f-8163-4236-af02-3518757f6ec2" (UID: "be04216f-8163-4236-af02-3518757f6ec2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:20:35.407349 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:35.407313    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/be04216f-8163-4236-af02-3518757f6ec2-proxy-tls\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:20:35.407349 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:35.407342    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/be04216f-8163-4236-af02-3518757f6ec2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:20:35.407349 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:35.407352    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dx7d\" (UniqueName: \"kubernetes.io/projected/be04216f-8163-4236-af02-3518757f6ec2-kube-api-access-8dx7d\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:20:36.016588 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.016532    2561 generic.go:356] "Generic (PLEG): container finished" podID="be04216f-8163-4236-af02-3518757f6ec2" containerID="5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36" exitCode=0
Jul 30 17:20:36.017029 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.016605    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"
Jul 30 17:20:36.017029 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.016621    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" event={"ID":"be04216f-8163-4236-af02-3518757f6ec2","Type":"ContainerDied","Data":"5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36"}
Jul 30 17:20:36.017029 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.016684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2" event={"ID":"be04216f-8163-4236-af02-3518757f6ec2","Type":"ContainerDied","Data":"2e2b9fdd4d467ce10d2d6a38c900403388e5ab9b60b80a5d2f17c70d2563fd75"}
Jul 30 17:20:36.017029 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.016710    2561 scope.go:117] "RemoveContainer" containerID="3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646"
Jul 30 17:20:36.025149 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.025130    2561 scope.go:117] "RemoveContainer" containerID="5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36"
Jul 30 17:20:36.035296 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.035262    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"]
Jul 30 17:20:36.035296 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.035280    2561 scope.go:117] "RemoveContainer" containerID="3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646"
Jul 30 17:20:36.035984 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:20:36.035844    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646\": container with ID starting with 3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646 not found: ID does not exist" containerID="3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646"
Jul 30 17:20:36.035984 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.035880    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646"} err="failed to get container status \"3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646\": rpc error: code = NotFound desc = could not find container \"3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646\": container with ID starting with 3ed27eae332ef468abad0142d85387ff54a2dc712c9915c4421520f486148646 not found: ID does not exist"
Jul 30 17:20:36.035984 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.035903    2561 scope.go:117] "RemoveContainer" containerID="5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36"
Jul 30 17:20:36.036490 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:20:36.036430    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36\": container with ID starting with 5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36 not found: ID does not exist" containerID="5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36"
Jul 30 17:20:36.036490 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.036459    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36"} err="failed to get container status \"5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36\": rpc error: code = NotFound desc = could not find container \"5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36\": container with ID starting with 5560ce2f1a63612b09185e1d3e852b26d8d192046f77432c941d2271967e3d36 not found: ID does not exist"
Jul 30 17:20:36.037882 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:36.037851    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8bf5c-predictor-7c8689d44-vmlm2"]
Jul 30 17:20:37.800671 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:37.800641    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be04216f-8163-4236-af02-3518757f6ec2" path="/var/lib/kubelet/pods/be04216f-8163-4236-af02-3518757f6ec2/volumes"
Jul 30 17:20:40.016158 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:40.016127    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:20:40.016644 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:40.016619    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 30 17:20:50.017105 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:20:50.017065    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 30 17:21:00.017103 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:00.017061    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 30 17:21:10.017450 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:10.017407    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 30 17:21:20.018457 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:20.018356    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:21:27.785760 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.785728    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"]
Jul 30 17:21:27.786181 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.785948    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kserve-container" containerID="cri-o://724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112" gracePeriod=30
Jul 30 17:21:27.786181 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.786006    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kube-rbac-proxy" containerID="cri-o://d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92" gracePeriod=30
Jul 30 17:21:27.918746 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.918713    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"]
Jul 30 17:21:27.919126 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.919109    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kserve-container"
Jul 30 17:21:27.919213 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.919129    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kserve-container"
Jul 30 17:21:27.919213 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.919157    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kube-rbac-proxy"
Jul 30 17:21:27.919213 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.919165    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kube-rbac-proxy"
Jul 30 17:21:27.919355 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.919255    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kserve-container"
Jul 30 17:21:27.919355 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.919267    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="be04216f-8163-4236-af02-3518757f6ec2" containerName="kube-rbac-proxy"
Jul 30 17:21:27.922251 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.922232    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:27.925406 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.925382    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-0186d-predictor-serving-cert\""
Jul 30 17:21:27.925493 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.925386    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-0186d-kube-rbac-proxy-sar-config\""
Jul 30 17:21:27.932665 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:27.932641    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"]
Jul 30 17:21:28.046527 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.046436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/91b80031-3d60-46b6-8a94-06ed1e507604-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0186d-predictor-7b75d7487d-s8wdp\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") " pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:28.046707 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.046529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/91b80031-3d60-46b6-8a94-06ed1e507604-proxy-tls\") pod \"error-404-isvc-0186d-predictor-7b75d7487d-s8wdp\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") " pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:28.046707 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.046615    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtj7n\" (UniqueName: \"kubernetes.io/projected/91b80031-3d60-46b6-8a94-06ed1e507604-kube-api-access-qtj7n\") pod \"error-404-isvc-0186d-predictor-7b75d7487d-s8wdp\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") " pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:28.147155 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.147118    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtj7n\" (UniqueName: \"kubernetes.io/projected/91b80031-3d60-46b6-8a94-06ed1e507604-kube-api-access-qtj7n\") pod \"error-404-isvc-0186d-predictor-7b75d7487d-s8wdp\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") " pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:28.147348 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.147165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/91b80031-3d60-46b6-8a94-06ed1e507604-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0186d-predictor-7b75d7487d-s8wdp\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") " pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:28.147348 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.147217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/91b80031-3d60-46b6-8a94-06ed1e507604-proxy-tls\") pod \"error-404-isvc-0186d-predictor-7b75d7487d-s8wdp\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") " pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:28.147934 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.147914    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/91b80031-3d60-46b6-8a94-06ed1e507604-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0186d-predictor-7b75d7487d-s8wdp\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") " pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:28.149931 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.149907    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/91b80031-3d60-46b6-8a94-06ed1e507604-proxy-tls\") pod \"error-404-isvc-0186d-predictor-7b75d7487d-s8wdp\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") " pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:28.156084 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.156063    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtj7n\" (UniqueName: \"kubernetes.io/projected/91b80031-3d60-46b6-8a94-06ed1e507604-kube-api-access-qtj7n\") pod \"error-404-isvc-0186d-predictor-7b75d7487d-s8wdp\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") " pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:28.234009 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.233974    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:28.253636 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.253607    2561 generic.go:356] "Generic (PLEG): container finished" podID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerID="d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92" exitCode=2
Jul 30 17:21:28.253747 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.253679    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" event={"ID":"97c5295d-ffa3-42b0-85e0-2fadca336069","Type":"ContainerDied","Data":"d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92"}
Jul 30 17:21:28.367962 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:28.367934    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"]
Jul 30 17:21:28.370584 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:21:28.370541    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b80031_3d60_46b6_8a94_06ed1e507604.slice/crio-d0a39cc791972263e5ddc1645746c2447f221ac8410379c22382c7be4198b641 WatchSource:0}: Error finding container d0a39cc791972263e5ddc1645746c2447f221ac8410379c22382c7be4198b641: Status 404 returned error can't find the container with id d0a39cc791972263e5ddc1645746c2447f221ac8410379c22382c7be4198b641
Jul 30 17:21:29.259433 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:29.259398    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" event={"ID":"91b80031-3d60-46b6-8a94-06ed1e507604","Type":"ContainerStarted","Data":"4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc"}
Jul 30 17:21:29.259854 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:29.259458    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" event={"ID":"91b80031-3d60-46b6-8a94-06ed1e507604","Type":"ContainerStarted","Data":"f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3"}
Jul 30 17:21:29.259854 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:29.259499    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:29.259854 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:29.259521    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" event={"ID":"91b80031-3d60-46b6-8a94-06ed1e507604","Type":"ContainerStarted","Data":"d0a39cc791972263e5ddc1645746c2447f221ac8410379c22382c7be4198b641"}
Jul 30 17:21:29.276248 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:29.276200    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" podStartSLOduration=2.276186846 podStartE2EDuration="2.276186846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:21:29.275328579 +0000 UTC m=+1266.004941076" watchObservedRunningTime="2026-07-30 17:21:29.276186846 +0000 UTC m=+1266.005799343"
Jul 30 17:21:30.264381 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:30.264339    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:30.265973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:30.265947    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Jul 30 17:21:30.875560 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:30.875520    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.34:8643/healthz\": dial tcp 10.132.0.34:8643: connect: connection refused"
Jul 30 17:21:30.881132 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:30.881097    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Jul 30 17:21:31.044878 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.044856    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:21:31.173069 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.172978    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wktv2\" (UniqueName: \"kubernetes.io/projected/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-api-access-wktv2\") pod \"97c5295d-ffa3-42b0-85e0-2fadca336069\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") "
Jul 30 17:21:31.173069 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.173055    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/97c5295d-ffa3-42b0-85e0-2fadca336069-proxy-tls\") pod \"97c5295d-ffa3-42b0-85e0-2fadca336069\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") "
Jul 30 17:21:31.173305 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.173077    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-rbac-proxy-sar-config\") pod \"97c5295d-ffa3-42b0-85e0-2fadca336069\" (UID: \"97c5295d-ffa3-42b0-85e0-2fadca336069\") "
Jul 30 17:21:31.173524 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.173496    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "97c5295d-ffa3-42b0-85e0-2fadca336069" (UID: "97c5295d-ffa3-42b0-85e0-2fadca336069"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:21:31.175314 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.175290    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-api-access-wktv2" (OuterVolumeSpecName: "kube-api-access-wktv2") pod "97c5295d-ffa3-42b0-85e0-2fadca336069" (UID: "97c5295d-ffa3-42b0-85e0-2fadca336069"). InnerVolumeSpecName "kube-api-access-wktv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:21:31.175412 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.175340    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c5295d-ffa3-42b0-85e0-2fadca336069-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "97c5295d-ffa3-42b0-85e0-2fadca336069" (UID: "97c5295d-ffa3-42b0-85e0-2fadca336069"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:21:31.270434 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.270399    2561 generic.go:356] "Generic (PLEG): container finished" podID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerID="724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112" exitCode=0
Jul 30 17:21:31.270851 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.270451    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"
Jul 30 17:21:31.270851 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.270483    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" event={"ID":"97c5295d-ffa3-42b0-85e0-2fadca336069","Type":"ContainerDied","Data":"724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112"}
Jul 30 17:21:31.270851 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.270537    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk" event={"ID":"97c5295d-ffa3-42b0-85e0-2fadca336069","Type":"ContainerDied","Data":"287c10d728e990472aacfbc6dcbfdbe8f705f6195714fd624e4e49854e8e6158"}
Jul 30 17:21:31.270851 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.270584    2561 scope.go:117] "RemoveContainer" containerID="d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92"
Jul 30 17:21:31.271071 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.270980    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Jul 30 17:21:31.273758 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.273733    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wktv2\" (UniqueName: \"kubernetes.io/projected/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-api-access-wktv2\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:21:31.273896 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.273761    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/97c5295d-ffa3-42b0-85e0-2fadca336069-proxy-tls\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:21:31.273896 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.273780    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/97c5295d-ffa3-42b0-85e0-2fadca336069-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:21:31.279643 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.279625    2561 scope.go:117] "RemoveContainer" containerID="724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112"
Jul 30 17:21:31.287911 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.287896    2561 scope.go:117] "RemoveContainer" containerID="d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92"
Jul 30 17:21:31.288162 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:21:31.288143    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92\": container with ID starting with d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92 not found: ID does not exist" containerID="d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92"
Jul 30 17:21:31.288275 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.288169    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92"} err="failed to get container status \"d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92\": rpc error: code = NotFound desc = could not find container \"d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92\": container with ID starting with d6e35ad749db130b7b2a9515ba7dc8acb8bd4df3577d4ca2f94ce293dc746a92 not found: ID does not exist"
Jul 30 17:21:31.288275 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.288186    2561 scope.go:117] "RemoveContainer" containerID="724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112"
Jul 30 17:21:31.288424 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:21:31.288409    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112\": container with ID starting with 724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112 not found: ID does not exist" containerID="724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112"
Jul 30 17:21:31.288466 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.288431    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112"} err="failed to get container status \"724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112\": rpc error: code = NotFound desc = could not find container \"724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112\": container with ID starting with 724635c646b49b85baaa1d00c1b118d6b0bda02a0573ccccf29776c7f63f4112 not found: ID does not exist"
Jul 30 17:21:31.291756 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.291736    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"]
Jul 30 17:21:31.293213 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.293196    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-9ae38-predictor-7d77d6b8b4-wqwmk"]
Jul 30 17:21:31.801706 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:31.801670    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" path="/var/lib/kubelet/pods/97c5295d-ffa3-42b0-85e0-2fadca336069/volumes"
Jul 30 17:21:36.275611 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:36.275577    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:21:36.276045 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:36.276020    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Jul 30 17:21:42.038223 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.038191    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"]
Jul 30 17:21:42.038680 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.038431    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kserve-container" containerID="cri-o://ea8716e3280014b435727cac927626e72445e14a361766dbf2e7dc1365cd37ac" gracePeriod=30
Jul 30 17:21:42.038680 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.038601    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kube-rbac-proxy" containerID="cri-o://36484d7c04d0ef6e213b0979b54d2b00f80d4bf9ae5755d6bc271f9b0a406400" gracePeriod=30
Jul 30 17:21:42.148214 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.148179    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"]
Jul 30 17:21:42.148604 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.148587    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kserve-container"
Jul 30 17:21:42.148678 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.148607    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kserve-container"
Jul 30 17:21:42.148678 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.148622    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kube-rbac-proxy"
Jul 30 17:21:42.148678 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.148627    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kube-rbac-proxy"
Jul 30 17:21:42.148769 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.148686    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kube-rbac-proxy"
Jul 30 17:21:42.148769 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.148697    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c5295d-ffa3-42b0-85e0-2fadca336069" containerName="kserve-container"
Jul 30 17:21:42.153353 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.153333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:42.155738 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.155708    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ba640-kube-rbac-proxy-sar-config\""
Jul 30 17:21:42.155845 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.155712    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ba640-predictor-serving-cert\""
Jul 30 17:21:42.159940 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.159882    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"]
Jul 30 17:21:42.268053 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.268016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f1312f36-767e-4f84-b880-dd85b85cc981-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ba640-predictor-597ff898bb-rmwlr\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") " pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:42.268235 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.268079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f1312f36-767e-4f84-b880-dd85b85cc981-proxy-tls\") pod \"error-404-isvc-ba640-predictor-597ff898bb-rmwlr\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") " pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:42.268235 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.268194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z24hc\" (UniqueName: \"kubernetes.io/projected/f1312f36-767e-4f84-b880-dd85b85cc981-kube-api-access-z24hc\") pod \"error-404-isvc-ba640-predictor-597ff898bb-rmwlr\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") " pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:42.325078 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.324986    2561 generic.go:356] "Generic (PLEG): container finished" podID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerID="36484d7c04d0ef6e213b0979b54d2b00f80d4bf9ae5755d6bc271f9b0a406400" exitCode=2
Jul 30 17:21:42.325078 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.325062    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" event={"ID":"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7","Type":"ContainerDied","Data":"36484d7c04d0ef6e213b0979b54d2b00f80d4bf9ae5755d6bc271f9b0a406400"}
Jul 30 17:21:42.369485 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.369445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f1312f36-767e-4f84-b880-dd85b85cc981-proxy-tls\") pod \"error-404-isvc-ba640-predictor-597ff898bb-rmwlr\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") " pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:42.369679 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.369529    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z24hc\" (UniqueName: \"kubernetes.io/projected/f1312f36-767e-4f84-b880-dd85b85cc981-kube-api-access-z24hc\") pod \"error-404-isvc-ba640-predictor-597ff898bb-rmwlr\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") " pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:42.369679 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.369601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f1312f36-767e-4f84-b880-dd85b85cc981-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ba640-predictor-597ff898bb-rmwlr\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") " pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:42.370340 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.370316    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f1312f36-767e-4f84-b880-dd85b85cc981-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ba640-predictor-597ff898bb-rmwlr\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") " pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:42.372138 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.372120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f1312f36-767e-4f84-b880-dd85b85cc981-proxy-tls\") pod \"error-404-isvc-ba640-predictor-597ff898bb-rmwlr\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") " pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:42.377681 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.377651    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z24hc\" (UniqueName: \"kubernetes.io/projected/f1312f36-767e-4f84-b880-dd85b85cc981-kube-api-access-z24hc\") pod \"error-404-isvc-ba640-predictor-597ff898bb-rmwlr\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") " pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:42.465477 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.465428    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:42.607759 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:42.607627    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"]
Jul 30 17:21:42.610585 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:21:42.610539    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1312f36_767e_4f84_b880_dd85b85cc981.slice/crio-027dfd0340471770a92ade76d4c174ba39f4d043052b8b514f6bd8c103258891 WatchSource:0}: Error finding container 027dfd0340471770a92ade76d4c174ba39f4d043052b8b514f6bd8c103258891: Status 404 returned error can't find the container with id 027dfd0340471770a92ade76d4c174ba39f4d043052b8b514f6bd8c103258891
Jul 30 17:21:43.331012 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:43.330973    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" event={"ID":"f1312f36-767e-4f84-b880-dd85b85cc981","Type":"ContainerStarted","Data":"54ccc50ef50c0236afd6a1cca8e4043d91ea0780e0f566c99596dad4b65e1b84"}
Jul 30 17:21:43.331392 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:43.331039    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:43.331392 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:43.331071    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:43.331392 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:43.331099    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" event={"ID":"f1312f36-767e-4f84-b880-dd85b85cc981","Type":"ContainerStarted","Data":"7e0342b903f407960ca397dcd7439d31080e7e378c39492af127e91f783ca28e"}
Jul 30 17:21:43.331392 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:43.331125    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" event={"ID":"f1312f36-767e-4f84-b880-dd85b85cc981","Type":"ContainerStarted","Data":"027dfd0340471770a92ade76d4c174ba39f4d043052b8b514f6bd8c103258891"}
Jul 30 17:21:43.332632 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:43.332607    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jul 30 17:21:43.347044 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:43.346994    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" podStartSLOduration=1.346975181 podStartE2EDuration="1.346975181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:21:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:21:43.346134807 +0000 UTC m=+1280.075747305" watchObservedRunningTime="2026-07-30 17:21:43.346975181 +0000 UTC m=+1280.076587680"
Jul 30 17:21:44.335414 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:44.335368    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jul 30 17:21:45.011409 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:45.011366    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jul 30 17:21:45.342794 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:45.342764    2561 generic.go:356] "Generic (PLEG): container finished" podID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerID="ea8716e3280014b435727cac927626e72445e14a361766dbf2e7dc1365cd37ac" exitCode=0
Jul 30 17:21:45.343165 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:45.342842    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" event={"ID":"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7","Type":"ContainerDied","Data":"ea8716e3280014b435727cac927626e72445e14a361766dbf2e7dc1365cd37ac"}
Jul 30 17:21:45.795625 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:45.795598    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:21:45.900260 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:45.900226    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-proxy-tls\") pod \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") "
Jul 30 17:21:45.900424 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:45.900274    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhqhg\" (UniqueName: \"kubernetes.io/projected/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-api-access-rhqhg\") pod \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") "
Jul 30 17:21:45.900424 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:45.900327    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-rbac-proxy-sar-config\") pod \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\" (UID: \"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7\") "
Jul 30 17:21:45.900784 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:45.900755    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" (UID: "d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:21:45.902478 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:45.902415    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" (UID: "d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:21:45.902588 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:45.902475    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-api-access-rhqhg" (OuterVolumeSpecName: "kube-api-access-rhqhg") pod "d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" (UID: "d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7"). InnerVolumeSpecName "kube-api-access-rhqhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:21:46.001675 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:46.001641    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:21:46.001675 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:46.001672    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-proxy-tls\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:21:46.001675 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:46.001683    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhqhg\" (UniqueName: \"kubernetes.io/projected/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7-kube-api-access-rhqhg\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:21:46.277057 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:46.277021    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Jul 30 17:21:46.349589 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:46.349543    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"
Jul 30 17:21:46.349589 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:46.349541    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q" event={"ID":"d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7","Type":"ContainerDied","Data":"41bcab8366e0f94b1408b844f6d8a6e240f2ba158c4a8288f84d215745a33c55"}
Jul 30 17:21:46.350057 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:46.349637    2561 scope.go:117] "RemoveContainer" containerID="36484d7c04d0ef6e213b0979b54d2b00f80d4bf9ae5755d6bc271f9b0a406400"
Jul 30 17:21:46.358654 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:46.358633    2561 scope.go:117] "RemoveContainer" containerID="ea8716e3280014b435727cac927626e72445e14a361766dbf2e7dc1365cd37ac"
Jul 30 17:21:46.371540 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:46.371519    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"]
Jul 30 17:21:46.377302 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:46.377282    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c48ce-predictor-574bbbb44b-4wv4q"]
Jul 30 17:21:47.801085 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:47.801053    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" path="/var/lib/kubelet/pods/d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7/volumes"
Jul 30 17:21:49.341082 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:49.341052    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:21:49.341617 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:49.341590    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jul 30 17:21:56.276104 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:56.276060    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Jul 30 17:21:59.342258 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:21:59.342211    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jul 30 17:22:06.276626 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:06.276579    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Jul 30 17:22:09.342402 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:09.342359    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jul 30 17:22:16.277341 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:16.277307    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:22:19.341626 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:19.341585    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jul 30 17:22:29.343204 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:29.343175    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:22:38.091414 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.091380    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"]
Jul 30 17:22:38.092092 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.091669    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kserve-container" containerID="cri-o://f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3" gracePeriod=30
Jul 30 17:22:38.092092 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.091755    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kube-rbac-proxy" containerID="cri-o://4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc" gracePeriod=30
Jul 30 17:22:38.211466 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.211435    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"]
Jul 30 17:22:38.211833 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.211819    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kube-rbac-proxy"
Jul 30 17:22:38.211881 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.211835    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kube-rbac-proxy"
Jul 30 17:22:38.211881 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.211852    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kserve-container"
Jul 30 17:22:38.211881 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.211857    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kserve-container"
Jul 30 17:22:38.211993 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.211919    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kserve-container"
Jul 30 17:22:38.211993 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.211932    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d070e8e1-32d3-4bb4-8096-c4e84ec6e3c7" containerName="kube-rbac-proxy"
Jul 30 17:22:38.214891 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.214860    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:38.217252 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.217233    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-2393a-predictor-serving-cert\""
Jul 30 17:22:38.217375 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.217279    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-2393a-kube-rbac-proxy-sar-config\""
Jul 30 17:22:38.225656 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.225618    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"]
Jul 30 17:22:38.311000 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.310965    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-proxy-tls\") pod \"error-404-isvc-2393a-predictor-7f54cccc56-6gwhd\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") " pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:38.311167 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.311008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-2393a-predictor-7f54cccc56-6gwhd\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") " pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:38.311167 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.311143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jmtq\" (UniqueName: \"kubernetes.io/projected/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-api-access-7jmtq\") pod \"error-404-isvc-2393a-predictor-7f54cccc56-6gwhd\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") " pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:38.412034 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.411942    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-proxy-tls\") pod \"error-404-isvc-2393a-predictor-7f54cccc56-6gwhd\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") " pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:38.412034 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.411985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-2393a-predictor-7f54cccc56-6gwhd\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") " pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:38.412034 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.412024    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jmtq\" (UniqueName: \"kubernetes.io/projected/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-api-access-7jmtq\") pod \"error-404-isvc-2393a-predictor-7f54cccc56-6gwhd\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") " pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:38.412732 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.412712    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-2393a-predictor-7f54cccc56-6gwhd\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") " pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:38.414535 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.414510    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-proxy-tls\") pod \"error-404-isvc-2393a-predictor-7f54cccc56-6gwhd\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") " pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:38.420833 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.420800    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jmtq\" (UniqueName: \"kubernetes.io/projected/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-api-access-7jmtq\") pod \"error-404-isvc-2393a-predictor-7f54cccc56-6gwhd\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") " pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:38.526882 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.526845    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:38.580293 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.580259    2561 generic.go:356] "Generic (PLEG): container finished" podID="91b80031-3d60-46b6-8a94-06ed1e507604" containerID="4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc" exitCode=2
Jul 30 17:22:38.580443 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.580386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" event={"ID":"91b80031-3d60-46b6-8a94-06ed1e507604","Type":"ContainerDied","Data":"4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc"}
Jul 30 17:22:38.660382 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:38.660323    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"]
Jul 30 17:22:38.662848 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:22:38.662775    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57865547_90c7_4aa9_b6d6_b5708fdf3ee3.slice/crio-eb7c2a2e627d33d53829d056a58239d98b564b5f2cfb59095bb553342ff2a9e8 WatchSource:0}: Error finding container eb7c2a2e627d33d53829d056a58239d98b564b5f2cfb59095bb553342ff2a9e8: Status 404 returned error can't find the container with id eb7c2a2e627d33d53829d056a58239d98b564b5f2cfb59095bb553342ff2a9e8
Jul 30 17:22:39.590176 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:39.590140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" event={"ID":"57865547-90c7-4aa9-b6d6-b5708fdf3ee3","Type":"ContainerStarted","Data":"f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40"}
Jul 30 17:22:39.590677 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:39.590198    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" event={"ID":"57865547-90c7-4aa9-b6d6-b5708fdf3ee3","Type":"ContainerStarted","Data":"5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2"}
Jul 30 17:22:39.590677 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:39.590227    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" event={"ID":"57865547-90c7-4aa9-b6d6-b5708fdf3ee3","Type":"ContainerStarted","Data":"eb7c2a2e627d33d53829d056a58239d98b564b5f2cfb59095bb553342ff2a9e8"}
Jul 30 17:22:39.590677 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:39.590306    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:39.607687 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:39.607644    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" podStartSLOduration=1.6076294089999998 podStartE2EDuration="1.607629409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:22:39.606767646 +0000 UTC m=+1336.336380163" watchObservedRunningTime="2026-07-30 17:22:39.607629409 +0000 UTC m=+1336.337241906"
Jul 30 17:22:40.595004 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:40.594974    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:40.597493 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:40.596580    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 30 17:22:41.344648 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.344624    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:22:41.437486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.437401    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/91b80031-3d60-46b6-8a94-06ed1e507604-kube-rbac-proxy-sar-config\") pod \"91b80031-3d60-46b6-8a94-06ed1e507604\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") "
Jul 30 17:22:41.437486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.437441    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/91b80031-3d60-46b6-8a94-06ed1e507604-proxy-tls\") pod \"91b80031-3d60-46b6-8a94-06ed1e507604\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") "
Jul 30 17:22:41.437486 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.437461    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtj7n\" (UniqueName: \"kubernetes.io/projected/91b80031-3d60-46b6-8a94-06ed1e507604-kube-api-access-qtj7n\") pod \"91b80031-3d60-46b6-8a94-06ed1e507604\" (UID: \"91b80031-3d60-46b6-8a94-06ed1e507604\") "
Jul 30 17:22:41.437795 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.437769    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91b80031-3d60-46b6-8a94-06ed1e507604-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "91b80031-3d60-46b6-8a94-06ed1e507604" (UID: "91b80031-3d60-46b6-8a94-06ed1e507604"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:22:41.439730 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.439707    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b80031-3d60-46b6-8a94-06ed1e507604-kube-api-access-qtj7n" (OuterVolumeSpecName: "kube-api-access-qtj7n") pod "91b80031-3d60-46b6-8a94-06ed1e507604" (UID: "91b80031-3d60-46b6-8a94-06ed1e507604"). InnerVolumeSpecName "kube-api-access-qtj7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:22:41.439730 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.439719    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91b80031-3d60-46b6-8a94-06ed1e507604-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "91b80031-3d60-46b6-8a94-06ed1e507604" (UID: "91b80031-3d60-46b6-8a94-06ed1e507604"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:22:41.538244 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.538217    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/91b80031-3d60-46b6-8a94-06ed1e507604-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:22:41.538244 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.538246    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/91b80031-3d60-46b6-8a94-06ed1e507604-proxy-tls\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:22:41.538409 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.538257    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtj7n\" (UniqueName: \"kubernetes.io/projected/91b80031-3d60-46b6-8a94-06ed1e507604-kube-api-access-qtj7n\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:22:41.600629 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.600592    2561 generic.go:356] "Generic (PLEG): container finished" podID="91b80031-3d60-46b6-8a94-06ed1e507604" containerID="f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3" exitCode=0
Jul 30 17:22:41.601108 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.600665    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"
Jul 30 17:22:41.601108 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.600679    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" event={"ID":"91b80031-3d60-46b6-8a94-06ed1e507604","Type":"ContainerDied","Data":"f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3"}
Jul 30 17:22:41.601108 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.600736    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" event={"ID":"91b80031-3d60-46b6-8a94-06ed1e507604","Type":"ContainerDied","Data":"d0a39cc791972263e5ddc1645746c2447f221ac8410379c22382c7be4198b641"}
Jul 30 17:22:41.601108 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.600762    2561 scope.go:117] "RemoveContainer" containerID="4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc"
Jul 30 17:22:41.601404 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.601374    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 30 17:22:41.609261 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.609240    2561 scope.go:117] "RemoveContainer" containerID="f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3"
Jul 30 17:22:41.616756 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.616740    2561 scope.go:117] "RemoveContainer" containerID="4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc"
Jul 30 17:22:41.617010 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:22:41.616991    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc\": container with ID starting with 4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc not found: ID does not exist" containerID="4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc"
Jul 30 17:22:41.617068 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.617018    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc"} err="failed to get container status \"4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc\": rpc error: code = NotFound desc = could not find container \"4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc\": container with ID starting with 4cb678ef18fcdcdcd82be5aa1493303566274d4c2b2d91fa3c7399c6fc1196bc not found: ID does not exist"
Jul 30 17:22:41.617068 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.617034    2561 scope.go:117] "RemoveContainer" containerID="f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3"
Jul 30 17:22:41.617230 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:22:41.617215    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3\": container with ID starting with f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3 not found: ID does not exist" containerID="f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3"
Jul 30 17:22:41.617270 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.617233    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3"} err="failed to get container status \"f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3\": rpc error: code = NotFound desc = could not find container \"f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3\": container with ID starting with f0802d55881dac0f179cb3cfdb9513b32e79e2a17fe5f2113efe0d321abeb0c3 not found: ID does not exist"
Jul 30 17:22:41.620896 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.620874    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"]
Jul 30 17:22:41.623853 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.623830    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp"]
Jul 30 17:22:41.800607 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:41.800571    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" path="/var/lib/kubelet/pods/91b80031-3d60-46b6-8a94-06ed1e507604/volumes"
Jul 30 17:22:42.272525 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:42.272479    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0186d-predictor-7b75d7487d-s8wdp" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 30 17:22:46.605721 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:46.605638    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:22:46.606178 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:46.606098    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 30 17:22:56.606199 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:22:56.606157    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 30 17:23:06.606112 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:23:06.606068    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 30 17:23:16.606979 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:23:16.606936    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 30 17:23:26.607218 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:23:26.607186    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:25:23.831384 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:25:23.831349    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:25:23.838212 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:25:23.838190    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:30:23.857119 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:23.857093    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:30:23.864128 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:23.864105    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:30:57.078160 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.078125    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"]
Jul 30 17:30:57.078739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.078351    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kserve-container" containerID="cri-o://7e0342b903f407960ca397dcd7439d31080e7e378c39492af127e91f783ca28e" gracePeriod=30
Jul 30 17:30:57.078739 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.078406    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kube-rbac-proxy" containerID="cri-o://54ccc50ef50c0236afd6a1cca8e4043d91ea0780e0f566c99596dad4b65e1b84" gracePeriod=30
Jul 30 17:30:57.103191 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.103165    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"]
Jul 30 17:30:57.103493 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.103481    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kube-rbac-proxy"
Jul 30 17:30:57.103544 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.103494    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kube-rbac-proxy"
Jul 30 17:30:57.103544 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.103506    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kserve-container"
Jul 30 17:30:57.103544 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.103519    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kserve-container"
Jul 30 17:30:57.103661 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.103601    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kube-rbac-proxy"
Jul 30 17:30:57.103661 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.103611    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b80031-3d60-46b6-8a94-06ed1e507604" containerName="kserve-container"
Jul 30 17:30:57.106718 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.106702    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.109397 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.109377    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-72b8e-kube-rbac-proxy-sar-config\""
Jul 30 17:30:57.109505 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.109375    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-72b8e-predictor-serving-cert\""
Jul 30 17:30:57.115170 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.115148    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"]
Jul 30 17:30:57.181541 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.181506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/54639b1a-a926-451f-b7b0-b77e41c2794b-proxy-tls\") pod \"error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") " pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.181541 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.181543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") " pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.181779 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.181640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpqm2\" (UniqueName: \"kubernetes.io/projected/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-api-access-mpqm2\") pod \"error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") " pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.282236 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.282196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/54639b1a-a926-451f-b7b0-b77e41c2794b-proxy-tls\") pod \"error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") " pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.282385 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.282250    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") " pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.282385 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.282314    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpqm2\" (UniqueName: \"kubernetes.io/projected/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-api-access-mpqm2\") pod \"error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") " pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.283027 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.282955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") " pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.284953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.284919    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/54639b1a-a926-451f-b7b0-b77e41c2794b-proxy-tls\") pod \"error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") " pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.292296 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.292270    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpqm2\" (UniqueName: \"kubernetes.io/projected/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-api-access-mpqm2\") pod \"error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") " pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.417902 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.417816    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.552161 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.552137    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"]
Jul 30 17:30:57.554371 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:30:57.554343    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54639b1a_a926_451f_b7b0_b77e41c2794b.slice/crio-995a299fd378d839c9e5567b41c3460be7ca4544272b76a1f23ab3d06e477105 WatchSource:0}: Error finding container 995a299fd378d839c9e5567b41c3460be7ca4544272b76a1f23ab3d06e477105: Status 404 returned error can't find the container with id 995a299fd378d839c9e5567b41c3460be7ca4544272b76a1f23ab3d06e477105
Jul 30 17:30:57.799803 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.799769    2561 generic.go:356] "Generic (PLEG): container finished" podID="f1312f36-767e-4f84-b880-dd85b85cc981" containerID="54ccc50ef50c0236afd6a1cca8e4043d91ea0780e0f566c99596dad4b65e1b84" exitCode=2
Jul 30 17:30:57.800529 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.800505    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" event={"ID":"f1312f36-767e-4f84-b880-dd85b85cc981","Type":"ContainerDied","Data":"54ccc50ef50c0236afd6a1cca8e4043d91ea0780e0f566c99596dad4b65e1b84"}
Jul 30 17:30:57.801480 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.801448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" event={"ID":"54639b1a-a926-451f-b7b0-b77e41c2794b","Type":"ContainerStarted","Data":"b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b"}
Jul 30 17:30:57.801591 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.801509    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" event={"ID":"54639b1a-a926-451f-b7b0-b77e41c2794b","Type":"ContainerStarted","Data":"8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7"}
Jul 30 17:30:57.801591 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.801539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" event={"ID":"54639b1a-a926-451f-b7b0-b77e41c2794b","Type":"ContainerStarted","Data":"995a299fd378d839c9e5567b41c3460be7ca4544272b76a1f23ab3d06e477105"}
Jul 30 17:30:57.801680 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.801666    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:57.819496 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:57.819447    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" podStartSLOduration=0.819432751 podStartE2EDuration="819.432751ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:30:57.817699892 +0000 UTC m=+1834.547312410" watchObservedRunningTime="2026-07-30 17:30:57.819432751 +0000 UTC m=+1834.549045248"
Jul 30 17:30:58.806621 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:58.806588    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:30:58.808192 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:58.808164    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jul 30 17:30:59.336349 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:59.336308    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.37:8643/healthz\": dial tcp 10.132.0.37:8643: connect: connection refused"
Jul 30 17:30:59.341780 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:59.341752    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Jul 30 17:30:59.810684 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:30:59.810641    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jul 30 17:31:00.816851 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:00.816818    2561 generic.go:356] "Generic (PLEG): container finished" podID="f1312f36-767e-4f84-b880-dd85b85cc981" containerID="7e0342b903f407960ca397dcd7439d31080e7e378c39492af127e91f783ca28e" exitCode=0
Jul 30 17:31:00.817166 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:00.816882    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" event={"ID":"f1312f36-767e-4f84-b880-dd85b85cc981","Type":"ContainerDied","Data":"7e0342b903f407960ca397dcd7439d31080e7e378c39492af127e91f783ca28e"}
Jul 30 17:31:00.831567 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:00.831518    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:31:00.914470 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:00.914435    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f1312f36-767e-4f84-b880-dd85b85cc981-proxy-tls\") pod \"f1312f36-767e-4f84-b880-dd85b85cc981\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") "
Jul 30 17:31:00.914652 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:00.914596    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f1312f36-767e-4f84-b880-dd85b85cc981-kube-rbac-proxy-sar-config\") pod \"f1312f36-767e-4f84-b880-dd85b85cc981\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") "
Jul 30 17:31:00.914652 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:00.914631    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z24hc\" (UniqueName: \"kubernetes.io/projected/f1312f36-767e-4f84-b880-dd85b85cc981-kube-api-access-z24hc\") pod \"f1312f36-767e-4f84-b880-dd85b85cc981\" (UID: \"f1312f36-767e-4f84-b880-dd85b85cc981\") "
Jul 30 17:31:00.914948 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:00.914916    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1312f36-767e-4f84-b880-dd85b85cc981-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f1312f36-767e-4f84-b880-dd85b85cc981" (UID: "f1312f36-767e-4f84-b880-dd85b85cc981"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:31:00.916615 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:00.916593    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1312f36-767e-4f84-b880-dd85b85cc981-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f1312f36-767e-4f84-b880-dd85b85cc981" (UID: "f1312f36-767e-4f84-b880-dd85b85cc981"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:31:00.916808 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:00.916786    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1312f36-767e-4f84-b880-dd85b85cc981-kube-api-access-z24hc" (OuterVolumeSpecName: "kube-api-access-z24hc") pod "f1312f36-767e-4f84-b880-dd85b85cc981" (UID: "f1312f36-767e-4f84-b880-dd85b85cc981"). InnerVolumeSpecName "kube-api-access-z24hc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:31:01.015947 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:01.015911    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f1312f36-767e-4f84-b880-dd85b85cc981-proxy-tls\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:31:01.015947 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:01.015941    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f1312f36-767e-4f84-b880-dd85b85cc981-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:31:01.015947 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:01.015951    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z24hc\" (UniqueName: \"kubernetes.io/projected/f1312f36-767e-4f84-b880-dd85b85cc981-kube-api-access-z24hc\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:31:01.822679 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:01.822651    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"
Jul 30 17:31:01.823098 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:01.822646    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr" event={"ID":"f1312f36-767e-4f84-b880-dd85b85cc981","Type":"ContainerDied","Data":"027dfd0340471770a92ade76d4c174ba39f4d043052b8b514f6bd8c103258891"}
Jul 30 17:31:01.823098 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:01.822809    2561 scope.go:117] "RemoveContainer" containerID="54ccc50ef50c0236afd6a1cca8e4043d91ea0780e0f566c99596dad4b65e1b84"
Jul 30 17:31:01.831876 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:01.831861    2561 scope.go:117] "RemoveContainer" containerID="7e0342b903f407960ca397dcd7439d31080e7e378c39492af127e91f783ca28e"
Jul 30 17:31:01.840737 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:01.840711    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"]
Jul 30 17:31:01.845439 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:01.845409    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ba640-predictor-597ff898bb-rmwlr"]
Jul 30 17:31:03.800737 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:03.800696    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" path="/var/lib/kubelet/pods/f1312f36-767e-4f84-b880-dd85b85cc981/volumes"
Jul 30 17:31:04.821395 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:04.821368    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:31:04.821905 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:04.821821    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jul 30 17:31:14.822262 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:14.822219    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jul 30 17:31:24.822783 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:24.822744    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jul 30 17:31:34.822496 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:34.822449    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jul 30 17:31:44.823184 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:44.823100    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:31:53.088730 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.088691    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"]
Jul 30 17:31:53.089219 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.088956    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kserve-container" containerID="cri-o://5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2" gracePeriod=30
Jul 30 17:31:53.089219 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.089074    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kube-rbac-proxy" containerID="cri-o://f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40" gracePeriod=30
Jul 30 17:31:53.209999 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.209966    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"]
Jul 30 17:31:53.210388 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.210370    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kube-rbac-proxy"
Jul 30 17:31:53.210474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.210390    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kube-rbac-proxy"
Jul 30 17:31:53.210474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.210413    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kserve-container"
Jul 30 17:31:53.210474 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.210422    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kserve-container"
Jul 30 17:31:53.210670 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.210509    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kube-rbac-proxy"
Jul 30 17:31:53.210670 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.210526    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1312f36-767e-4f84-b880-dd85b85cc981" containerName="kserve-container"
Jul 30 17:31:53.213603 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.213583    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:53.216111 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.216089    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-0086b-kube-rbac-proxy-sar-config\""
Jul 30 17:31:53.216219 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.216089    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-0086b-predictor-serving-cert\""
Jul 30 17:31:53.222452 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.222427    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"]
Jul 30 17:31:53.251731 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.251685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") " pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:53.251917 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.251767    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-proxy-tls\") pod \"error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") " pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:53.251917 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.251851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxknk\" (UniqueName: \"kubernetes.io/projected/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-api-access-zxknk\") pod \"error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") " pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:53.352731 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.352640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") " pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:53.352731 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.352685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-proxy-tls\") pod \"error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") " pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:53.352731 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.352728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxknk\" (UniqueName: \"kubernetes.io/projected/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-api-access-zxknk\") pod \"error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") " pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:53.353017 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:31:53.352866    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-0086b-predictor-serving-cert: secret "error-404-isvc-0086b-predictor-serving-cert" not found
Jul 30 17:31:53.353017 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:31:53.352943    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-proxy-tls podName:71d5e4d3-d56f-4b5c-bb40-352ed8d60920 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:53.852922835 +0000 UTC m=+1890.582535316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-proxy-tls") pod "error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" (UID: "71d5e4d3-d56f-4b5c-bb40-352ed8d60920") : secret "error-404-isvc-0086b-predictor-serving-cert" not found
Jul 30 17:31:53.353337 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.353318    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") " pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:53.361239 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.361205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxknk\" (UniqueName: \"kubernetes.io/projected/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-api-access-zxknk\") pod \"error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") " pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:53.856696 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.856655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-proxy-tls\") pod \"error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") " pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:53.859279 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:53.859255    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-proxy-tls\") pod \"error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") " pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:54.057668 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:54.057624    2561 generic.go:356] "Generic (PLEG): container finished" podID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerID="f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40" exitCode=2
Jul 30 17:31:54.057851 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:54.057688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" event={"ID":"57865547-90c7-4aa9-b6d6-b5708fdf3ee3","Type":"ContainerDied","Data":"f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40"}
Jul 30 17:31:54.125147 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:54.125072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:54.267105 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:54.264905    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"]
Jul 30 17:31:54.270662 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:31:54.270637    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d5e4d3_d56f_4b5c_bb40_352ed8d60920.slice/crio-d074d51f1d4f10078bd628f0a3694dadc703ae2abfb56910f40bce038d97c17a WatchSource:0}: Error finding container d074d51f1d4f10078bd628f0a3694dadc703ae2abfb56910f40bce038d97c17a: Status 404 returned error can't find the container with id d074d51f1d4f10078bd628f0a3694dadc703ae2abfb56910f40bce038d97c17a
Jul 30 17:31:55.064320 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:55.064280    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" event={"ID":"71d5e4d3-d56f-4b5c-bb40-352ed8d60920","Type":"ContainerStarted","Data":"70d5b2e156d046f68d5c28c25f42b5169b65c803d7abde1456d22e8885647ae0"}
Jul 30 17:31:55.064533 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:55.064357    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" event={"ID":"71d5e4d3-d56f-4b5c-bb40-352ed8d60920","Type":"ContainerStarted","Data":"4bc371b8fec7f3bdaac8392642d70c920471ebede49c200375dceb192b521e93"}
Jul 30 17:31:55.064533 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:55.064385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" event={"ID":"71d5e4d3-d56f-4b5c-bb40-352ed8d60920","Type":"ContainerStarted","Data":"d074d51f1d4f10078bd628f0a3694dadc703ae2abfb56910f40bce038d97c17a"}
Jul 30 17:31:55.064533 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:55.064417    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:55.064533 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:55.064445    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:31:55.065822 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:55.065792    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Jul 30 17:31:55.080849 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:55.080793    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" podStartSLOduration=2.08077243 podStartE2EDuration="2.08077243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:55.079425441 +0000 UTC m=+1891.809037940" watchObservedRunningTime="2026-07-30 17:31:55.08077243 +0000 UTC m=+1891.810384931"
Jul 30 17:31:56.069380 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:56.069337    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Jul 30 17:31:56.345636 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:56.345613    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:31:56.477114 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:56.477084    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-proxy-tls\") pod \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") "
Jul 30 17:31:56.477299 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:56.477190    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-rbac-proxy-sar-config\") pod \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") "
Jul 30 17:31:56.477299 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:56.477222    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jmtq\" (UniqueName: \"kubernetes.io/projected/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-api-access-7jmtq\") pod \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\" (UID: \"57865547-90c7-4aa9-b6d6-b5708fdf3ee3\") "
Jul 30 17:31:56.477589 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:56.477530    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "57865547-90c7-4aa9-b6d6-b5708fdf3ee3" (UID: "57865547-90c7-4aa9-b6d6-b5708fdf3ee3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:31:56.479392 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:56.479360    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "57865547-90c7-4aa9-b6d6-b5708fdf3ee3" (UID: "57865547-90c7-4aa9-b6d6-b5708fdf3ee3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:31:56.479502 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:56.479411    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-api-access-7jmtq" (OuterVolumeSpecName: "kube-api-access-7jmtq") pod "57865547-90c7-4aa9-b6d6-b5708fdf3ee3" (UID: "57865547-90c7-4aa9-b6d6-b5708fdf3ee3"). InnerVolumeSpecName "kube-api-access-7jmtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:31:56.577952 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:56.577866    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:31:56.577952 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:56.577895    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jmtq\" (UniqueName: \"kubernetes.io/projected/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-kube-api-access-7jmtq\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:31:56.577952 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:56.577904    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/57865547-90c7-4aa9-b6d6-b5708fdf3ee3-proxy-tls\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:31:57.077318 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.077289    2561 generic.go:356] "Generic (PLEG): container finished" podID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerID="5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2" exitCode=0
Jul 30 17:31:57.077784 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.077350    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"
Jul 30 17:31:57.077784 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.077351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" event={"ID":"57865547-90c7-4aa9-b6d6-b5708fdf3ee3","Type":"ContainerDied","Data":"5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2"}
Jul 30 17:31:57.077784 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.077411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd" event={"ID":"57865547-90c7-4aa9-b6d6-b5708fdf3ee3","Type":"ContainerDied","Data":"eb7c2a2e627d33d53829d056a58239d98b564b5f2cfb59095bb553342ff2a9e8"}
Jul 30 17:31:57.077784 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.077436    2561 scope.go:117] "RemoveContainer" containerID="f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40"
Jul 30 17:31:57.087584 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.087524    2561 scope.go:117] "RemoveContainer" containerID="5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2"
Jul 30 17:31:57.095778 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.095758    2561 scope.go:117] "RemoveContainer" containerID="f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40"
Jul 30 17:31:57.096037 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:31:57.096018    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40\": container with ID starting with f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40 not found: ID does not exist" containerID="f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40"
Jul 30 17:31:57.096108 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.096052    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40"} err="failed to get container status \"f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40\": rpc error: code = NotFound desc = could not find container \"f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40\": container with ID starting with f496cfb4440e5b68565bc7af308a7af8afa8e70f20b7e2aaacd8fb780c9dfa40 not found: ID does not exist"
Jul 30 17:31:57.096108 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.096074    2561 scope.go:117] "RemoveContainer" containerID="5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2"
Jul 30 17:31:57.096351 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:31:57.096331    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2\": container with ID starting with 5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2 not found: ID does not exist" containerID="5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2"
Jul 30 17:31:57.096394 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.096359    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2"} err="failed to get container status \"5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2\": rpc error: code = NotFound desc = could not find container \"5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2\": container with ID starting with 5a3d52b53fcbd56c66e75d9a7bfc399cbdba7855086f0c28b0d33500bfb52ec2 not found: ID does not exist"
Jul 30 17:31:57.106860 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.106833    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"]
Jul 30 17:31:57.118512 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.118488    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2393a-predictor-7f54cccc56-6gwhd"]
Jul 30 17:31:57.801115 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:31:57.801073    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" path="/var/lib/kubelet/pods/57865547-90c7-4aa9-b6d6-b5708fdf3ee3/volumes"
Jul 30 17:32:01.073999 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:01.073969    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:32:01.074473 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:01.074385    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Jul 30 17:32:07.255687 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.255651    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"]
Jul 30 17:32:07.256195 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.255925    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kserve-container" containerID="cri-o://8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7" gracePeriod=30
Jul 30 17:32:07.256195 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.255977    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kube-rbac-proxy" containerID="cri-o://b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b" gracePeriod=30
Jul 30 17:32:07.480397 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.480361    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"]
Jul 30 17:32:07.480796 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.480781    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kserve-container"
Jul 30 17:32:07.480862 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.480799    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kserve-container"
Jul 30 17:32:07.480862 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.480819    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kube-rbac-proxy"
Jul 30 17:32:07.480862 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.480825    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kube-rbac-proxy"
Jul 30 17:32:07.481026 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.480890    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kserve-container"
Jul 30 17:32:07.481026 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.480902    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="57865547-90c7-4aa9-b6d6-b5708fdf3ee3" containerName="kube-rbac-proxy"
Jul 30 17:32:07.484052 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.484034    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:07.487126 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.486869    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-60a78-predictor-serving-cert\""
Jul 30 17:32:07.487126 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.486883    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-60a78-kube-rbac-proxy-sar-config\""
Jul 30 17:32:07.494072 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.494050    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"]
Jul 30 17:32:07.572752 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.572649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw8vb\" (UniqueName: \"kubernetes.io/projected/a856de58-5625-44d4-8eac-02f90d436d53-kube-api-access-xw8vb\") pod \"error-404-isvc-60a78-predictor-5c8547b7c6-55b72\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") " pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:07.572943 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.572903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a856de58-5625-44d4-8eac-02f90d436d53-proxy-tls\") pod \"error-404-isvc-60a78-predictor-5c8547b7c6-55b72\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") " pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:07.573024 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.572984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a856de58-5625-44d4-8eac-02f90d436d53-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-60a78-predictor-5c8547b7c6-55b72\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") " pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:07.674398 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.674359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a856de58-5625-44d4-8eac-02f90d436d53-proxy-tls\") pod \"error-404-isvc-60a78-predictor-5c8547b7c6-55b72\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") " pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:07.674635 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.674415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a856de58-5625-44d4-8eac-02f90d436d53-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-60a78-predictor-5c8547b7c6-55b72\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") " pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:07.674635 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.674462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw8vb\" (UniqueName: \"kubernetes.io/projected/a856de58-5625-44d4-8eac-02f90d436d53-kube-api-access-xw8vb\") pod \"error-404-isvc-60a78-predictor-5c8547b7c6-55b72\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") " pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:07.674635 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:32:07.674519    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-60a78-predictor-serving-cert: secret "error-404-isvc-60a78-predictor-serving-cert" not found
Jul 30 17:32:07.674635 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:32:07.674613    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a856de58-5625-44d4-8eac-02f90d436d53-proxy-tls podName:a856de58-5625-44d4-8eac-02f90d436d53 nodeName:}" failed. No retries permitted until 2026-07-30 17:32:08.174592157 +0000 UTC m=+1904.904204636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a856de58-5625-44d4-8eac-02f90d436d53-proxy-tls") pod "error-404-isvc-60a78-predictor-5c8547b7c6-55b72" (UID: "a856de58-5625-44d4-8eac-02f90d436d53") : secret "error-404-isvc-60a78-predictor-serving-cert" not found
Jul 30 17:32:07.675265 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.675241    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a856de58-5625-44d4-8eac-02f90d436d53-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-60a78-predictor-5c8547b7c6-55b72\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") " pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:07.684093 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:07.684056    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw8vb\" (UniqueName: \"kubernetes.io/projected/a856de58-5625-44d4-8eac-02f90d436d53-kube-api-access-xw8vb\") pod \"error-404-isvc-60a78-predictor-5c8547b7c6-55b72\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") " pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:08.129780 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:08.129745    2561 generic.go:356] "Generic (PLEG): container finished" podID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerID="b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b" exitCode=2
Jul 30 17:32:08.129960 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:08.129823    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" event={"ID":"54639b1a-a926-451f-b7b0-b77e41c2794b","Type":"ContainerDied","Data":"b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b"}
Jul 30 17:32:08.179490 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:08.179441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a856de58-5625-44d4-8eac-02f90d436d53-proxy-tls\") pod \"error-404-isvc-60a78-predictor-5c8547b7c6-55b72\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") " pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:08.182102 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:08.182068    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a856de58-5625-44d4-8eac-02f90d436d53-proxy-tls\") pod \"error-404-isvc-60a78-predictor-5c8547b7c6-55b72\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") " pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:08.395665 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:08.395582    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:08.540702 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:08.540638    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"]
Jul 30 17:32:08.543613 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:32:08.543582    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda856de58_5625_44d4_8eac_02f90d436d53.slice/crio-a47d375ec57a1790a20b96a1aa86b747119a466e6f9480187196151f6423c4d8 WatchSource:0}: Error finding container a47d375ec57a1790a20b96a1aa86b747119a466e6f9480187196151f6423c4d8: Status 404 returned error can't find the container with id a47d375ec57a1790a20b96a1aa86b747119a466e6f9480187196151f6423c4d8
Jul 30 17:32:09.136592 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:09.136535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" event={"ID":"a856de58-5625-44d4-8eac-02f90d436d53","Type":"ContainerStarted","Data":"7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968"}
Jul 30 17:32:09.136803 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:09.136613    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" event={"ID":"a856de58-5625-44d4-8eac-02f90d436d53","Type":"ContainerStarted","Data":"7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2"}
Jul 30 17:32:09.136803 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:09.136634    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" event={"ID":"a856de58-5625-44d4-8eac-02f90d436d53","Type":"ContainerStarted","Data":"a47d375ec57a1790a20b96a1aa86b747119a466e6f9480187196151f6423c4d8"}
Jul 30 17:32:09.136803 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:09.136750    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:09.136930 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:09.136812    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:09.138325 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:09.138299    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Jul 30 17:32:09.155292 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:09.155249    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" podStartSLOduration=2.155234369 podStartE2EDuration="2.155234369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:32:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:32:09.154172332 +0000 UTC m=+1905.883784853" watchObservedRunningTime="2026-07-30 17:32:09.155234369 +0000 UTC m=+1905.884846867"
Jul 30 17:32:09.811234 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:09.811188    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.39:8643/healthz\": dial tcp 10.132.0.39:8643: connect: connection refused"
Jul 30 17:32:10.141674 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:10.141581    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Jul 30 17:32:10.714138 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:10.714112    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:32:10.802759 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:10.802677    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/54639b1a-a926-451f-b7b0-b77e41c2794b-proxy-tls\") pod \"54639b1a-a926-451f-b7b0-b77e41c2794b\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") "
Jul 30 17:32:10.802759 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:10.802746    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-rbac-proxy-sar-config\") pod \"54639b1a-a926-451f-b7b0-b77e41c2794b\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") "
Jul 30 17:32:10.802945 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:10.802796    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpqm2\" (UniqueName: \"kubernetes.io/projected/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-api-access-mpqm2\") pod \"54639b1a-a926-451f-b7b0-b77e41c2794b\" (UID: \"54639b1a-a926-451f-b7b0-b77e41c2794b\") "
Jul 30 17:32:10.803147 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:10.803115    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "54639b1a-a926-451f-b7b0-b77e41c2794b" (UID: "54639b1a-a926-451f-b7b0-b77e41c2794b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:32:10.805040 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:10.805018    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54639b1a-a926-451f-b7b0-b77e41c2794b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "54639b1a-a926-451f-b7b0-b77e41c2794b" (UID: "54639b1a-a926-451f-b7b0-b77e41c2794b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:32:10.805121 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:10.805073    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-api-access-mpqm2" (OuterVolumeSpecName: "kube-api-access-mpqm2") pod "54639b1a-a926-451f-b7b0-b77e41c2794b" (UID: "54639b1a-a926-451f-b7b0-b77e41c2794b"). InnerVolumeSpecName "kube-api-access-mpqm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:32:10.903899 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:10.903860    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/54639b1a-a926-451f-b7b0-b77e41c2794b-proxy-tls\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:32:10.903899 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:10.903890    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:32:10.903899 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:10.903899    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpqm2\" (UniqueName: \"kubernetes.io/projected/54639b1a-a926-451f-b7b0-b77e41c2794b-kube-api-access-mpqm2\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:32:11.075157 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.075063    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Jul 30 17:32:11.147531 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.147498    2561 generic.go:356] "Generic (PLEG): container finished" podID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerID="8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7" exitCode=0
Jul 30 17:32:11.147733 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.147577    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"
Jul 30 17:32:11.147733 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.147588    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" event={"ID":"54639b1a-a926-451f-b7b0-b77e41c2794b","Type":"ContainerDied","Data":"8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7"}
Jul 30 17:32:11.147733 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.147651    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh" event={"ID":"54639b1a-a926-451f-b7b0-b77e41c2794b","Type":"ContainerDied","Data":"995a299fd378d839c9e5567b41c3460be7ca4544272b76a1f23ab3d06e477105"}
Jul 30 17:32:11.147733 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.147679    2561 scope.go:117] "RemoveContainer" containerID="b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b"
Jul 30 17:32:11.156673 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.156657    2561 scope.go:117] "RemoveContainer" containerID="8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7"
Jul 30 17:32:11.164108 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.164089    2561 scope.go:117] "RemoveContainer" containerID="b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b"
Jul 30 17:32:11.164354 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:32:11.164337    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b\": container with ID starting with b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b not found: ID does not exist" containerID="b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b"
Jul 30 17:32:11.164393 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.164364    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b"} err="failed to get container status \"b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b\": rpc error: code = NotFound desc = could not find container \"b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b\": container with ID starting with b816bd9ec82843aab44a33d777d4762681ff48b666356e87aefb194a1626583b not found: ID does not exist"
Jul 30 17:32:11.164393 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.164380    2561 scope.go:117] "RemoveContainer" containerID="8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7"
Jul 30 17:32:11.164617 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:32:11.164599    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7\": container with ID starting with 8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7 not found: ID does not exist" containerID="8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7"
Jul 30 17:32:11.164664 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.164628    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7"} err="failed to get container status \"8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7\": rpc error: code = NotFound desc = could not find container \"8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7\": container with ID starting with 8db29bd97efa06c2d633f2cc85da241f32a2326cc44ef2c9056a61df32e080e7 not found: ID does not exist"
Jul 30 17:32:11.168625 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.168606    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"]
Jul 30 17:32:11.173923 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.173903    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-72b8e-predictor-6766cbb94d-pvdxh"]
Jul 30 17:32:11.806123 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:11.806087    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" path="/var/lib/kubelet/pods/54639b1a-a926-451f-b7b0-b77e41c2794b/volumes"
Jul 30 17:32:15.146351 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:15.146322    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:32:15.146793 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:15.146763    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Jul 30 17:32:21.074428 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:21.074389    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Jul 30 17:32:25.147568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:25.147506    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Jul 30 17:32:31.075455 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:31.075407    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.40:8080: connect: connection refused"
Jul 30 17:32:35.147512 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:35.147468    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Jul 30 17:32:41.075518 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:41.075486    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:32:45.146819 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:45.146781    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Jul 30 17:32:55.148208 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:32:55.148179    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:35:23.885342 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:35:23.885309    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:35:23.891826 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:35:23.891801    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:40:23.911587 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:40:23.911451    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:40:23.917912 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:40:23.917890    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:41:22.326572 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:22.326518    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"]
Jul 30 17:41:22.327191 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:22.326785    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kserve-container" containerID="cri-o://7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2" gracePeriod=30
Jul 30 17:41:22.327191 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:22.326848    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kube-rbac-proxy" containerID="cri-o://7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968" gracePeriod=30
Jul 30 17:41:22.550029 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:22.549994    2561 generic.go:356] "Generic (PLEG): container finished" podID="a856de58-5625-44d4-8eac-02f90d436d53" containerID="7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968" exitCode=2
Jul 30 17:41:22.550201 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:22.550067    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" event={"ID":"a856de58-5625-44d4-8eac-02f90d436d53","Type":"ContainerDied","Data":"7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968"}
Jul 30 17:41:25.142684 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.142628    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.41:8643/healthz\": dial tcp 10.132.0.41:8643: connect: connection refused"
Jul 30 17:41:25.147103 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.147076    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.41:8080: connect: connection refused"
Jul 30 17:41:25.476369 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.476343    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:41:25.562146 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.562117    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw8vb\" (UniqueName: \"kubernetes.io/projected/a856de58-5625-44d4-8eac-02f90d436d53-kube-api-access-xw8vb\") pod \"a856de58-5625-44d4-8eac-02f90d436d53\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") "
Jul 30 17:41:25.562353 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.562171    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a856de58-5625-44d4-8eac-02f90d436d53-proxy-tls\") pod \"a856de58-5625-44d4-8eac-02f90d436d53\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") "
Jul 30 17:41:25.562353 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.562265    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a856de58-5625-44d4-8eac-02f90d436d53-kube-rbac-proxy-sar-config\") pod \"a856de58-5625-44d4-8eac-02f90d436d53\" (UID: \"a856de58-5625-44d4-8eac-02f90d436d53\") "
Jul 30 17:41:25.562740 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.562705    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a856de58-5625-44d4-8eac-02f90d436d53-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a856de58-5625-44d4-8eac-02f90d436d53" (UID: "a856de58-5625-44d4-8eac-02f90d436d53"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:41:25.563767 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.563737    2561 generic.go:356] "Generic (PLEG): container finished" podID="a856de58-5625-44d4-8eac-02f90d436d53" containerID="7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2" exitCode=0
Jul 30 17:41:25.563911 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.563798    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"
Jul 30 17:41:25.563911 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.563825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" event={"ID":"a856de58-5625-44d4-8eac-02f90d436d53","Type":"ContainerDied","Data":"7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2"}
Jul 30 17:41:25.563911 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.563890    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72" event={"ID":"a856de58-5625-44d4-8eac-02f90d436d53","Type":"ContainerDied","Data":"a47d375ec57a1790a20b96a1aa86b747119a466e6f9480187196151f6423c4d8"}
Jul 30 17:41:25.564098 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.563925    2561 scope.go:117] "RemoveContainer" containerID="7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968"
Jul 30 17:41:25.564712 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.564686    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a856de58-5625-44d4-8eac-02f90d436d53-kube-api-access-xw8vb" (OuterVolumeSpecName: "kube-api-access-xw8vb") pod "a856de58-5625-44d4-8eac-02f90d436d53" (UID: "a856de58-5625-44d4-8eac-02f90d436d53"). InnerVolumeSpecName "kube-api-access-xw8vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:41:25.564826 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.564710    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a856de58-5625-44d4-8eac-02f90d436d53-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a856de58-5625-44d4-8eac-02f90d436d53" (UID: "a856de58-5625-44d4-8eac-02f90d436d53"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:41:25.579293 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.579273    2561 scope.go:117] "RemoveContainer" containerID="7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2"
Jul 30 17:41:25.586851 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.586835    2561 scope.go:117] "RemoveContainer" containerID="7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968"
Jul 30 17:41:25.587133 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:41:25.587115    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968\": container with ID starting with 7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968 not found: ID does not exist" containerID="7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968"
Jul 30 17:41:25.587188 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.587147    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968"} err="failed to get container status \"7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968\": rpc error: code = NotFound desc = could not find container \"7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968\": container with ID starting with 7c18ebcd4bed60f86d9941bd7bda55bcc9425d3e7621647f8d90b46fbe591968 not found: ID does not exist"
Jul 30 17:41:25.587188 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.587173    2561 scope.go:117] "RemoveContainer" containerID="7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2"
Jul 30 17:41:25.587412 ip-10-0-137-57 kubenswrapper[2561]: E0730 17:41:25.587392    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2\": container with ID starting with 7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2 not found: ID does not exist" containerID="7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2"
Jul 30 17:41:25.587485 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.587422    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2"} err="failed to get container status \"7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2\": rpc error: code = NotFound desc = could not find container \"7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2\": container with ID starting with 7d26c236a5f969ab3de54ba18802b9d9ef8bf52f2e4efbf3747956b4966b67c2 not found: ID does not exist"
Jul 30 17:41:25.663098 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.663013    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a856de58-5625-44d4-8eac-02f90d436d53-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:41:25.663098 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.663041    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw8vb\" (UniqueName: \"kubernetes.io/projected/a856de58-5625-44d4-8eac-02f90d436d53-kube-api-access-xw8vb\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:41:25.663098 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.663056    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a856de58-5625-44d4-8eac-02f90d436d53-proxy-tls\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:41:25.879234 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.879201    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"]
Jul 30 17:41:25.883115 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:25.883093    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-60a78-predictor-5c8547b7c6-55b72"]
Jul 30 17:41:27.801255 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:41:27.801220    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a856de58-5625-44d4-8eac-02f90d436d53" path="/var/lib/kubelet/pods/a856de58-5625-44d4-8eac-02f90d436d53/volumes"
Jul 30 17:45:23.937005 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:45:23.936876    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:45:23.943895 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:45:23.943874    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:49:12.641862 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:12.641826    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"]
Jul 30 17:49:12.642451 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:12.642054    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kserve-container" containerID="cri-o://4bc371b8fec7f3bdaac8392642d70c920471ebede49c200375dceb192b521e93" gracePeriod=30
Jul 30 17:49:12.642451 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:12.642100    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kube-rbac-proxy" containerID="cri-o://70d5b2e156d046f68d5c28c25f42b5169b65c803d7abde1456d22e8885647ae0" gracePeriod=30
Jul 30 17:49:13.566824 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:13.566785    2561 generic.go:356] "Generic (PLEG): container finished" podID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerID="70d5b2e156d046f68d5c28c25f42b5169b65c803d7abde1456d22e8885647ae0" exitCode=2
Jul 30 17:49:13.566992 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:13.566860    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" event={"ID":"71d5e4d3-d56f-4b5c-bb40-352ed8d60920","Type":"ContainerDied","Data":"70d5b2e156d046f68d5c28c25f42b5169b65c803d7abde1456d22e8885647ae0"}
Jul 30 17:49:15.577851 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.577823    2561 generic.go:356] "Generic (PLEG): container finished" podID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerID="4bc371b8fec7f3bdaac8392642d70c920471ebede49c200375dceb192b521e93" exitCode=0
Jul 30 17:49:15.578285 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.577869    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" event={"ID":"71d5e4d3-d56f-4b5c-bb40-352ed8d60920","Type":"ContainerDied","Data":"4bc371b8fec7f3bdaac8392642d70c920471ebede49c200375dceb192b521e93"}
Jul 30 17:49:15.690901 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.690878    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:49:15.769816 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.769728    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-proxy-tls\") pod \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") "
Jul 30 17:49:15.769969 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.769840    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxknk\" (UniqueName: \"kubernetes.io/projected/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-api-access-zxknk\") pod \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") "
Jul 30 17:49:15.769969 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.769864    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-rbac-proxy-sar-config\") pod \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\" (UID: \"71d5e4d3-d56f-4b5c-bb40-352ed8d60920\") "
Jul 30 17:49:15.770287 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.770253    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "71d5e4d3-d56f-4b5c-bb40-352ed8d60920" (UID: "71d5e4d3-d56f-4b5c-bb40-352ed8d60920"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:49:15.771998 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.771965    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "71d5e4d3-d56f-4b5c-bb40-352ed8d60920" (UID: "71d5e4d3-d56f-4b5c-bb40-352ed8d60920"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:49:15.771998 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.771961    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-api-access-zxknk" (OuterVolumeSpecName: "kube-api-access-zxknk") pod "71d5e4d3-d56f-4b5c-bb40-352ed8d60920" (UID: "71d5e4d3-d56f-4b5c-bb40-352ed8d60920"). InnerVolumeSpecName "kube-api-access-zxknk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:49:15.871042 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.871006    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxknk\" (UniqueName: \"kubernetes.io/projected/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-api-access-zxknk\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:49:15.871042 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.871039    2561 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:49:15.871042 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:15.871050    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71d5e4d3-d56f-4b5c-bb40-352ed8d60920-proxy-tls\") on node \"ip-10-0-137-57.ec2.internal\" DevicePath \"\""
Jul 30 17:49:16.583212 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:16.583182    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"
Jul 30 17:49:16.583212 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:16.583200    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs" event={"ID":"71d5e4d3-d56f-4b5c-bb40-352ed8d60920","Type":"ContainerDied","Data":"d074d51f1d4f10078bd628f0a3694dadc703ae2abfb56910f40bce038d97c17a"}
Jul 30 17:49:16.583780 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:16.583284    2561 scope.go:117] "RemoveContainer" containerID="70d5b2e156d046f68d5c28c25f42b5169b65c803d7abde1456d22e8885647ae0"
Jul 30 17:49:16.591749 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:16.591733    2561 scope.go:117] "RemoveContainer" containerID="4bc371b8fec7f3bdaac8392642d70c920471ebede49c200375dceb192b521e93"
Jul 30 17:49:16.603080 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:16.603056    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"]
Jul 30 17:49:16.608218 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:16.608196    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0086b-predictor-cbdcc74d4-gvmhs"]
Jul 30 17:49:17.800387 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:17.800355    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" path="/var/lib/kubelet/pods/71d5e4d3-d56f-4b5c-bb40-352ed8d60920/volumes"
Jul 30 17:49:47.870274 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:47.870195    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zsm4g_9ed19618-5096-494b-b51f-d80f84f2b7a9/global-pull-secret-syncer/0.log"
Jul 30 17:49:47.990821 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:47.990787    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zpbkp_3e8be5d1-1706-4b21-90b8-2e502085e034/konnectivity-agent/0.log"
Jul 30 17:49:48.065421 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:48.065395    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-57.ec2.internal_e2d5e43724ffee48daaf282f2e083298/haproxy/0.log"
Jul 30 17:49:52.212429 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:52.212384    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-s5c9f_0399577e-b99f-4403-a296-04f3e4609d34/cluster-monitoring-operator/0.log"
Jul 30 17:49:52.526532 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:52.526439    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqhxm_5ddb0461-8589-4063-ad33-31da25ddd3da/node-exporter/0.log"
Jul 30 17:49:52.548720 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:52.548689    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqhxm_5ddb0461-8589-4063-ad33-31da25ddd3da/kube-rbac-proxy/0.log"
Jul 30 17:49:52.579779 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:52.579756    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqhxm_5ddb0461-8589-4063-ad33-31da25ddd3da/init-textfile/0.log"
Jul 30 17:49:55.299693 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:55.299663    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/2.log"
Jul 30 17:49:55.307230 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:55.307205    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-zjlzr_f7f639b3-092f-48bd-81a8-86a3dd28ba5f/console-operator/3.log"
Jul 30 17:49:56.280962 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.280928    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"]
Jul 30 17:49:56.281288 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281274    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kube-rbac-proxy"
Jul 30 17:49:56.281341 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281291    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kube-rbac-proxy"
Jul 30 17:49:56.281341 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281307    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kserve-container"
Jul 30 17:49:56.281341 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281313    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kserve-container"
Jul 30 17:49:56.281341 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281320    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kube-rbac-proxy"
Jul 30 17:49:56.281341 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281326    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kube-rbac-proxy"
Jul 30 17:49:56.281341 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281331    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kube-rbac-proxy"
Jul 30 17:49:56.281341 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281336    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kube-rbac-proxy"
Jul 30 17:49:56.281568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281344    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kserve-container"
Jul 30 17:49:56.281568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281349    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kserve-container"
Jul 30 17:49:56.281568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281355    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kserve-container"
Jul 30 17:49:56.281568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281360    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kserve-container"
Jul 30 17:49:56.281568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281412    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kube-rbac-proxy"
Jul 30 17:49:56.281568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281420    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54639b1a-a926-451f-b7b0-b77e41c2794b" containerName="kserve-container"
Jul 30 17:49:56.281568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281427    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kube-rbac-proxy"
Jul 30 17:49:56.281568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281433    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kserve-container"
Jul 30 17:49:56.281568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281438    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a856de58-5625-44d4-8eac-02f90d436d53" containerName="kserve-container"
Jul 30 17:49:56.281568 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.281444    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d5e4d3-d56f-4b5c-bb40-352ed8d60920" containerName="kube-rbac-proxy"
Jul 30 17:49:56.284417 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.284390    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.286973 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.286948    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-45p7p\"/\"openshift-service-ca.crt\""
Jul 30 17:49:56.287953 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.287938    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-45p7p\"/\"default-dockercfg-lhkfc\""
Jul 30 17:49:56.288016 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.287962    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-45p7p\"/\"kube-root-ca.crt\""
Jul 30 17:49:56.300426 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.300404    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"]
Jul 30 17:49:56.325416 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.325384    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-zqd88_4d2ca850-8032-4937-ad30-812d16c4b565/volume-data-source-validator/0.log"
Jul 30 17:49:56.404532 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.404497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvj5v\" (UniqueName: \"kubernetes.io/projected/3924cba9-2a78-4c1c-93ea-d499845774c9-kube-api-access-vvj5v\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.404532 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.404537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-sys\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.404776 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.404587    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-podres\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.404776 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.404630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-lib-modules\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.404776 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.404660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-proc\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.505950 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.505918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-lib-modules\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.506152 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.505961    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-proc\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.506152 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.506018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvj5v\" (UniqueName: \"kubernetes.io/projected/3924cba9-2a78-4c1c-93ea-d499845774c9-kube-api-access-vvj5v\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.506152 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.506047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-sys\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.506152 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.506068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-podres\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.506152 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.506093    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-lib-modules\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.506152 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.506122    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-sys\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.506365 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.506099    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-proc\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.506365 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.506180    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3924cba9-2a78-4c1c-93ea-d499845774c9-podres\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.514927 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.514901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvj5v\" (UniqueName: \"kubernetes.io/projected/3924cba9-2a78-4c1c-93ea-d499845774c9-kube-api-access-vvj5v\") pod \"perf-node-gather-daemonset-pqkw6\" (UID: \"3924cba9-2a78-4c1c-93ea-d499845774c9\") " pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.593705 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.593621    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:56.724608 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.724581    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"]
Jul 30 17:49:56.727458 ip-10-0-137-57 kubenswrapper[2561]: W0730 17:49:56.727423    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3924cba9_2a78_4c1c_93ea_d499845774c9.slice/crio-7c75e5cbcac29901a3ab0ed82a7c4670ac31da4e102c68609fabfcce306eea05 WatchSource:0}: Error finding container 7c75e5cbcac29901a3ab0ed82a7c4670ac31da4e102c68609fabfcce306eea05: Status 404 returned error can't find the container with id 7c75e5cbcac29901a3ab0ed82a7c4670ac31da4e102c68609fabfcce306eea05
Jul 30 17:49:56.762100 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:56.762073    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6" event={"ID":"3924cba9-2a78-4c1c-93ea-d499845774c9","Type":"ContainerStarted","Data":"7c75e5cbcac29901a3ab0ed82a7c4670ac31da4e102c68609fabfcce306eea05"}
Jul 30 17:49:57.367188 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:57.367159    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jpxpz_c8189d07-aacf-4e6e-9d50-01259f44f2b4/dns/0.log"
Jul 30 17:49:57.391309 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:57.391285    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jpxpz_c8189d07-aacf-4e6e-9d50-01259f44f2b4/kube-rbac-proxy/0.log"
Jul 30 17:49:57.469496 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:57.469465    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w95np_0dccf377-bcac-4887-92eb-672c457457ad/dns-node-resolver/0.log"
Jul 30 17:49:57.768694 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:57.768662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6" event={"ID":"3924cba9-2a78-4c1c-93ea-d499845774c9","Type":"ContainerStarted","Data":"a0748717dfe90eb10e4a91fc00d8802474a49f3a9c23eeb7f85c7bc229cb3e49"}
Jul 30 17:49:57.768906 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:57.768785    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:49:57.785969 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:57.785915    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6" podStartSLOduration=1.7858973200000001 podStartE2EDuration="1.78589732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:49:57.784352622 +0000 UTC m=+2974.513965141" watchObservedRunningTime="2026-07-30 17:49:57.78589732 +0000 UTC m=+2974.515509861"
Jul 30 17:49:57.989903 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:57.989862    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-98hsx_41d50b58-6804-479b-a731-a2e3e4d3b2cd/node-ca/0.log"
Jul 30 17:49:58.755771 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:58.755741    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9bcb675bf-2m6c4_5178ee7e-3787-4167-9ed8-b6f255fc4190/router/0.log"
Jul 30 17:49:59.077103 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:59.077024    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jlf8x_d70dea2b-c5ea-403d-9811-a21ddfe1f30f/serve-healthcheck-canary/0.log"
Jul 30 17:49:59.491798 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:59.491768    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-ssf4q_5e5aec98-ff5b-433e-a248-e4a03acb903a/insights-operator/0.log"
Jul 30 17:49:59.492592 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:59.492544    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-ssf4q_5e5aec98-ff5b-433e-a248-e4a03acb903a/insights-operator/1.log"
Jul 30 17:49:59.514434 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:59.514407    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9jpt5_f9d1ef43-e1f0-4112-954b-bd0e771f0fee/kube-rbac-proxy/0.log"
Jul 30 17:49:59.537475 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:59.537438    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9jpt5_f9d1ef43-e1f0-4112-954b-bd0e771f0fee/exporter/0.log"
Jul 30 17:49:59.562732 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:49:59.562699    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9jpt5_f9d1ef43-e1f0-4112-954b-bd0e771f0fee/extractor/0.log"
Jul 30 17:50:01.966987 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:01.966960    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-8677446b84-mx9rl_47c0a714-a4e8-4a4b-82ff-df16d1a5b6be/manager/0.log"
Jul 30 17:50:02.000650 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:02.000620    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-js68t_a1049d54-12e9-4e1b-b9ed-83ef963e6fca/manager/0.log"
Jul 30 17:50:03.783117 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:03.783085    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-45p7p/perf-node-gather-daemonset-pqkw6"
Jul 30 17:50:06.330258 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:06.330169    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-5k7vq_1ca4429d-274f-4b69-8573-7a62e2b526b5/migrator/0.log"
Jul 30 17:50:06.351146 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:06.351123    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-5k7vq_1ca4429d-274f-4b69-8573-7a62e2b526b5/graceful-termination/0.log"
Jul 30 17:50:06.652705 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:06.652621    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx_a5e39baa-3777-40c0-a8bf-9ee9ac9f2800/kube-storage-version-migrator-operator/1.log"
Jul 30 17:50:06.654455 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:06.654424    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-88kfx_a5e39baa-3777-40c0-a8bf-9ee9ac9f2800/kube-storage-version-migrator-operator/0.log"
Jul 30 17:50:07.833821 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:07.833794    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rt6d_61d58ea8-bcd8-4e2b-a42a-2f352f966a26/kube-multus-additional-cni-plugins/0.log"
Jul 30 17:50:07.855642 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:07.855615    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rt6d_61d58ea8-bcd8-4e2b-a42a-2f352f966a26/egress-router-binary-copy/0.log"
Jul 30 17:50:07.877760 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:07.877737    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rt6d_61d58ea8-bcd8-4e2b-a42a-2f352f966a26/cni-plugins/0.log"
Jul 30 17:50:07.898605 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:07.898582    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rt6d_61d58ea8-bcd8-4e2b-a42a-2f352f966a26/bond-cni-plugin/0.log"
Jul 30 17:50:07.919239 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:07.919215    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rt6d_61d58ea8-bcd8-4e2b-a42a-2f352f966a26/routeoverride-cni/0.log"
Jul 30 17:50:07.938980 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:07.938958    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rt6d_61d58ea8-bcd8-4e2b-a42a-2f352f966a26/whereabouts-cni-bincopy/0.log"
Jul 30 17:50:07.961413 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:07.961391    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rt6d_61d58ea8-bcd8-4e2b-a42a-2f352f966a26/whereabouts-cni/0.log"
Jul 30 17:50:08.159502 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:08.159383    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d4rpt_5eaf9a96-2e16-4093-b5f1-9a8ab242b1eb/kube-multus/0.log"
Jul 30 17:50:08.287032 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:08.286999    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8h2br_6e3bd573-f6fa-4ab5-8aff-d0c113a700ac/network-metrics-daemon/0.log"
Jul 30 17:50:08.304077 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:08.304017    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8h2br_6e3bd573-f6fa-4ab5-8aff-d0c113a700ac/kube-rbac-proxy/0.log"
Jul 30 17:50:09.591078 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:09.591050    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf9jb_0114f8e3-aa50-42e7-94f1-b0394d76da17/ovn-controller/0.log"
Jul 30 17:50:09.609591 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:09.609563    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf9jb_0114f8e3-aa50-42e7-94f1-b0394d76da17/ovn-acl-logging/0.log"
Jul 30 17:50:09.637439 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:09.637416    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf9jb_0114f8e3-aa50-42e7-94f1-b0394d76da17/kube-rbac-proxy-node/0.log"
Jul 30 17:50:09.663032 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:09.663000    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf9jb_0114f8e3-aa50-42e7-94f1-b0394d76da17/kube-rbac-proxy-ovn-metrics/0.log"
Jul 30 17:50:09.684098 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:09.684061    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf9jb_0114f8e3-aa50-42e7-94f1-b0394d76da17/northd/0.log"
Jul 30 17:50:09.711513 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:09.711481    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf9jb_0114f8e3-aa50-42e7-94f1-b0394d76da17/nbdb/0.log"
Jul 30 17:50:09.735248 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:09.735223    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf9jb_0114f8e3-aa50-42e7-94f1-b0394d76da17/sbdb/0.log"
Jul 30 17:50:09.810020 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:09.809985    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf9jb_0114f8e3-aa50-42e7-94f1-b0394d76da17/ovnkube-controller/0.log"
Jul 30 17:50:10.825719 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:10.825689    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-z565h_7868b999-9c89-456d-afa9-8e418549dfe9/check-endpoints/0.log"
Jul 30 17:50:10.851771 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:10.851742    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-59w8z_b2e74fdd-1e27-4058-9fd2-c45fa2071573/network-check-target-container/0.log"
Jul 30 17:50:11.858688 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:11.858665    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-z5w75_1dbb4c7d-0db6-445e-8460-82ba99d62c2b/iptables-alerter/0.log"
Jul 30 17:50:12.532697 ip-10-0-137-57 kubenswrapper[2561]: I0730 17:50:12.532670    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-6ncrg_77466359-549d-44f7-bfd1-feae2b80d29c/tuned/0.log"