Jul 10 18:56:16.521325 ip-10-0-131-123 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 18:56:16.521336 ip-10-0-131-123 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 18:56:16.521344 ip-10-0-131-123 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 18:56:16.521610 ip-10-0-131-123 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 18:56:26.524597 ip-10-0-131-123 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 10 18:56:26.524617 ip-10-0-131-123 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 83c8efdebd5647b7af6d5bd7955bcd82 --
Jul 10 18:58:20.437643 ip-10-0-131-123 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.780114    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.784978    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.784991    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.784996    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785000    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785003    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785007    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785011    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:20.848366 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785015    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785021    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785024    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785028    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785032    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785036    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785042    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785047    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785058    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785062    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785066    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785070    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785074    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785077    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785081    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785085    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785088    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785092    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785097    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:20.849469 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785100    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785104    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785108    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785112    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785116    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785120    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785123    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785127    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785130    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785133    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785137    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785141    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785146    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785150    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785153    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785156    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785160    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785164    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785167    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785171    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:20.852497 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785174    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785178    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785183    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785190    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785195    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785200    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785204    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785207    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785211    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785215    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785219    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785223    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785227    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785231    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785236    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785240    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785245    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785248    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785252    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:20.854721 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785256    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785259    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785263    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785267    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785271    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785274    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785278    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785281    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785285    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785288    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785292    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785296    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785299    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785302    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785306    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785309    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785313    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785317    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785320    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:20.857333 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785323    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785327    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785331    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785334    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785337    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785343    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785346    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785350    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785354    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785358    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785362    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785365    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785381    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785385    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.785389    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786344    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786352    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786356    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786361    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:20.859464 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786365    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786389    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786393    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786397    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786401    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786405    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786409    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786412    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786416    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786421    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786424    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786428    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786432    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786436    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786439    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786443    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786446    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786450    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786454    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786458    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:20.862099 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786462    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:20.860626 ip-10-0-131-123 systemd[1]: Started Kubernetes Kubelet.
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786465    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786469    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786473    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786476    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786480    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786484    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786488    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786492    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786495    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786499    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786502    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786506    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786510    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786514    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786518    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786521    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786524    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786528    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:20.864312 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786531    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786537    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786542    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786547    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786551    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786555    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786561    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786566    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786570    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786574    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786578    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786582    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786586    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786589    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786593    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786597    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786600    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786604    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786607    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:20.866866 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786611    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786614    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786617    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786621    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786624    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786628    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786631    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786635    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786641    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786646    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786650    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786655    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786659    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786662    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786666    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786669    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786673    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786676    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786680    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786683    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:20.869088 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786687    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786690    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786694    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786697    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786700    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786705    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786709    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786713    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786716    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786719    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786723    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786727    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786731    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786735    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786738    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786741    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.786745    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787286    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787293    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787297    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:20.871979 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787301    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787306    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787311    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787315    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787319    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787322    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787326    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787330    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787333    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787338    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787341    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787344    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787348    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787351    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787355    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787358    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787362    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787380    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787383    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787387    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:20.874942 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787391    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787395    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787399    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787403    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787407    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787410    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787421    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787425    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787429    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787433    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787436    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787440    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787443    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787451    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787455    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787459    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787463    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787466    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787469    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:20.876470 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787473    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787477    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787480    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787483    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787487    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787490    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787494    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787499    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787504    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787508    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787512    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787515    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787518    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787522    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787526    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787531    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787535    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787539    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787542    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:20.877527 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787546    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787549    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787553    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787556    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787561    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787567    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787571    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787576    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787579    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787583    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787587    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787591    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787594    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787599    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787603    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787606    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787610    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787613    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787617    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:20.879344 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787620    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787624    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787627    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787631    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787635    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787638    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787642    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787645    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787648    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787652    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787656    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787660    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787663    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787667    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787670    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787673    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787677    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787682    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.787687    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787777    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787791    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 18:58:20.880017 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787799    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787804    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787811    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787816    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787821    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787827    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787831    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787835    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787840    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787845    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787849    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787853    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787857    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787861    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787865    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787869    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787875    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787879    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787884    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787888    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787893    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787897    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787901    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 18:58:20.880965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787906    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787911    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787914    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787918    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787922    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787927    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787931    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787936    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787943    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787947    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787950    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787954    2579 flags.go:64] FLAG: --enable-server="true"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787959    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787965    2579 flags.go:64] FLAG: --event-burst="100"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787969    2579 flags.go:64] FLAG: --event-qps="50"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787973    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787977    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787981    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787987    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787991    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.787996    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788000    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788004    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788009    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788013    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 18:58:20.881894 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788017    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788021    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788025    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788029    2579 flags.go:64] FLAG: --feature-gates=""
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788033    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788037    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788042    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788046    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788050    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788054    2579 flags.go:64] FLAG: --help="false"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788058    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-131-123.ec2.internal"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788062    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788066    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788070    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788075    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788083    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788087    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788091    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788095    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788099    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788104    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788108    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788112    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788116    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 18:58:20.882953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788120    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788124    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788128    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788132    2579 flags.go:64] FLAG: --lock-file=""
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788136    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788139    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788144    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788151    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788155    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788158    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788162    2579 flags.go:64] FLAG: --logging-format="text"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788166    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788171    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788175    2579 flags.go:64] FLAG: --manifest-url=""
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788178    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788184    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788187    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788192    2579 flags.go:64] FLAG: --max-pods="110"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788197    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788201    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788204    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788209    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788212    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788219    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788223    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 18:58:20.885654 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788233    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788237    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788241    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788245    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788250    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788257    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788261    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788266    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788270    2579 flags.go:64] FLAG: --port="10250"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788275    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788279    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d3667cfa4976bfad"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788283    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788287    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788291    2579 flags.go:64] FLAG: --register-node="true"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788295    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788301    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788305    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788309    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788312    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788317    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788321    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788326    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788330    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788333    2579 flags.go:64] FLAG: --runonce="false"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788337    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 18:58:20.886701 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788341    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788345    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788349    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788353    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788357    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788363    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788384    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788389    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788393    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788397    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788401    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788406    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788410    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788414    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788421    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788425    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788429    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788435    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788439    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788443    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788447    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788451    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788455    2579 flags.go:64] FLAG: --v="2"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788460    2579 flags.go:64] FLAG: --version="false"
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788466    2579 flags.go:64] FLAG: --vmodule=""
Jul 10 18:58:20.888148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788470    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.788474    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788620    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788627    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788632    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788636    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788639    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788643    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788646    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788650    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788654    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788658    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788663    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788669    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788672    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788676    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788681    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788685    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788688    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788692    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:20.889107 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788696    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788699    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788704    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788707    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788711    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788714    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788718    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788721    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788724    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788728    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788732    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788735    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788739    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788743    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788746    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788749    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788754    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788757    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788761    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788764    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:20.890174 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788768    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788773    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788777    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788782    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788787    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788792    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788796    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788799    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788803    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788809    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788814    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788817    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788821    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788846    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788859    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788863    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788866    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788868    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788873    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:20.902772 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788876    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788878    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788881    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788884    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788886    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788889    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788891    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788894    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788897    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788900    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788903    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788906    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788908    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788911    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788914    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788916    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788920    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788922    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788925    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788927    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:20.907207 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788931    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788934    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788936    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788939    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788942    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788945    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788948    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788960    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788962    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788965    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788970    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788973    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788976    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788979    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788982    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788985    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788987    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788990    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788993    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788995    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:20.908087 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.788998    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.789000    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.789604    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.796321    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.796336    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.797059    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.797069    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797146    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797152    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797155    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797158    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797161    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797164    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797167    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:20.909337 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797171    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797175    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797178    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797180    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797183    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797186    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797189    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797191    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797194    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797196    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797199    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797202    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797204    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797207    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797209    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797212    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797214    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797218    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797221    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797223    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:20.909978 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797226    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797229    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797237    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797240    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797243    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797247    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797250    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797253    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797256    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797259    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797261    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797264    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797268    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797271    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797274    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797276    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797279    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797282    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:20.910804 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797284    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797287    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797290    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797292    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797295    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797298    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797300    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797303    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797305    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797307    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797310    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797313    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797316    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797319    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797321    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797323    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797326    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797334    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797343    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797345    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:20.912259 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797348    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797351    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797353    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797355    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797358    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797360    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797362    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797365    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797383    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797386    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797388    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797391    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797393    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797396    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797398    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797401    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797404    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797407    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797409    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797412    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:21.004325 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797415    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797417    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797419    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797425    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797427    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797430    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797432    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797435    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797437    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797440    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797448    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797451    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797455    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797458    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.797463    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:58:21.005073 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797639    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797644    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797647    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797650    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797653    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797656    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797658    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797661    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797663    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797666    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797668    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797671    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797673    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797676    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797678    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797681    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797683    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797686    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797688    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797690    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 18:58:21.005645 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797693    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797698    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797702    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797705    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797708    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797710    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797713    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797715    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797723    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797727    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797730    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797732    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797734    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797737    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797739    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797745    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797748    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797750    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797753    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 18:58:21.006225 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797755    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797757    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797760    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797762    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797774    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797778    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797781    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797784    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797787    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797789    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797792    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797794    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797797    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797800    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797803    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797806    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797808    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797811    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797813    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 18:58:21.006852 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797816    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797818    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797820    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797829    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797832    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797835    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797837    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797840    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797842    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797845    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797847    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797850    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797852    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797854    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797857    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797859    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797862    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797864    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797866    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797869    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 18:58:21.007548 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797872    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797874    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797876    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797879    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797881    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797884    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797886    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797889    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797892    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797894    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797897    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797899    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797901    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797904    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797908    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797913    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797921    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797924    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797927    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797930    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 18:58:21.008124 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:20.797932    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.797937    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.798033    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.800218    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.801503    2579 server.go:1019] "Starting client certificate rotation"
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.801597    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.801626    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.804267    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.809971    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.820977    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.823080    2579 log.go:25] "Validated CRI v1 image API"
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.823919    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 18:58:21.008757 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.827964    2579 fs.go:135] Filesystem UUIDs: map[6b08e343-e004-40be-9b54-05c3824d9be2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c4d5d65a-e8db-41b2-9fcd-ba0d1897c8ab:/dev/nvme0n1p3]
Jul 10 18:58:21.009120 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.827978    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 18:58:21.009120 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.832863    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.833117    2579 manager.go:216] Machine: {Timestamp:2026-07-10 18:58:20.831733493 +0000 UTC m=+0.288283884 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199388 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a4fdd46d3f8c6cabf418e27973655 SystemUUID:ec2a4fdd-46d3-f8c6-cabf-418e27973655 BootID:83c8efde-bd56-47b7-af6d-5bd7955bcd82 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:90:e4:ae:77:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:90:e4:ae:77:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:0e:4a:83:31:c9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.833210    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.833283    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.836173    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.836194    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.836883    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.836892    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.836899    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.837462    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.838437    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.842263    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.842382    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.842410    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.842419    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.842429    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.842439    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.842447    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 18:58:21.009387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.842799    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.842818    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.845342    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.847565    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.847600    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848310    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848328    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848337    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848345    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848356    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848364    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848388    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848397    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848406    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848414    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848426    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.848433    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.849103    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.849114    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.857108    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-123.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:20.857180    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:20.857353    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.857457    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-45ck9"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.859817    2579 server.go:1268] "Started kubelet"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.859879    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.859874    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.859933    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.861727    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.862181    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.863003    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-45ck9"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:20.864402    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-123.ec2.internal.18c102b44f183e34  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-123.ec2.internal,UID:ip-10-0-131-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-123.ec2.internal,},FirstTimestamp:2026-07-10 18:58:20.859784756 +0000 UTC m=+0.316335125,LastTimestamp:2026-07-10 18:58:20.859784756 +0000 UTC m=+0.316335125,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-123.ec2.internal,}"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:20.869410    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.869640    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.869648    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:20.869737    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.870610    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.871680    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.871697    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.871795    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.871806    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 18:58:21.009893 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.872431    2579 factory.go:55] Registering systemd factory
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.872447    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.872667    2579 factory.go:153] Registering CRI-O factory
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.872681    2579 factory.go:223] Registration of the crio container factory successfully
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.872747    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.872777    2579 factory.go:103] Registering Raw factory
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.872823    2579 manager.go:1196] Started watching for new ooms in manager
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.873647    2579 manager.go:349] Starting recovery of all containers
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.875520    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:20.910979    2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-123.ec2.internal\" not found" node="ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.927688    2579 manager.go:354] Recovery completed
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.932666    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.934599    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.934628    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.934641    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.935180    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.935191    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.935206    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.935212    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.935933    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.935955    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.935964    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.937260    2579 policy_none.go:49] "None policy: Start"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.937273    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.937283    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.939313    2579 policy_none.go:47] "Start"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:20.972792    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.996089    2579 manager.go:337] "Starting Device Plugin manager"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:20.996209    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.996220    2579 server.go:87] "Starting device plugin registration server"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.996409    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.996422    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.996863    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.996946    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:20.996958    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:20.997387    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 18:58:21.010929 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:20.997425    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.096954    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.097849    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.097881    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.097892    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.097918    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.103768    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.103796    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-123.ec2.internal\": node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.107997    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.116390    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.116431    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.116463    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.116506    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.118879    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:21.138190 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.133973    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.216940    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"]
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.217041    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.218643    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.218669    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.218681    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.220994    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.221116    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.221142    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.221635    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.221645    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.221655    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.221662    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.221669    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.221672    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.223888    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.223913    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.224535    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.224555    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.224565    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.234045    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.249130    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-123.ec2.internal\" not found" node="ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.254390    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-123.ec2.internal\" not found" node="ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.274110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/852848d9a6955f404681b7955865ce86-config\") pod \"kube-apiserver-proxy-ip-10-0-131-123.ec2.internal\" (UID: \"852848d9a6955f404681b7955865ce86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.274132    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d4bca704f227a6e54773cc110a279cbf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"d4bca704f227a6e54773cc110a279cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.316253 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.274149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4bca704f227a6e54773cc110a279cbf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"d4bca704f227a6e54773cc110a279cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.501338 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.334806    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.501338 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.374969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/852848d9a6955f404681b7955865ce86-config\") pod \"kube-apiserver-proxy-ip-10-0-131-123.ec2.internal\" (UID: \"852848d9a6955f404681b7955865ce86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.501338 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.374990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d4bca704f227a6e54773cc110a279cbf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"d4bca704f227a6e54773cc110a279cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.501338 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.375009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4bca704f227a6e54773cc110a279cbf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"d4bca704f227a6e54773cc110a279cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.501338 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.375036    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4bca704f227a6e54773cc110a279cbf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"d4bca704f227a6e54773cc110a279cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.501338 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.375072    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/852848d9a6955f404681b7955865ce86-config\") pod \"kube-apiserver-proxy-ip-10-0-131-123.ec2.internal\" (UID: \"852848d9a6955f404681b7955865ce86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.501338 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.375091    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d4bca704f227a6e54773cc110a279cbf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"d4bca704f227a6e54773cc110a279cbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.501338 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.437844    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.692499 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.542178    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.692499 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.553561    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.692499 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.557224    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:21.692499 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.646729    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.835702 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.750710    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.835702 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.801427    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 18:58:21.835702 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.801556    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:58:21.835702 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.801582    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 18:58:21.993068 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.851784    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:21.993068 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.869881    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 18:53:21 +0000 UTC" deadline="2028-03-18 17:09:08.794359886 +0000 UTC"
Jul 10 18:58:21.993068 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:21.869904    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14806h10m46.924459268s"
Jul 10 18:58:21.993068 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:21.952110    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:22.155005 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:22.052840    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:22.155005 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:22.153290    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:22.327369 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.164322    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:22.327369 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:22.213706    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852848d9a6955f404681b7955865ce86.slice/crio-fea834334c2e57c8b82e6b8f45fb07237a3ef137734aeadcfc2a67eb114b1f4a WatchSource:0}: Error finding container fea834334c2e57c8b82e6b8f45fb07237a3ef137734aeadcfc2a67eb114b1f4a: Status 404 returned error can't find the container with id fea834334c2e57c8b82e6b8f45fb07237a3ef137734aeadcfc2a67eb114b1f4a
Jul 10 18:58:22.327369 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.218623    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 18:58:22.327369 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:22.229484    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4bca704f227a6e54773cc110a279cbf.slice/crio-4fbf466c89de1f18c087960196c8148c202bfd8b1854c07116793dba58d07c6e WatchSource:0}: Error finding container 4fbf466c89de1f18c087960196c8148c202bfd8b1854c07116793dba58d07c6e: Status 404 returned error can't find the container with id 4fbf466c89de1f18c087960196c8148c202bfd8b1854c07116793dba58d07c6e
Jul 10 18:58:22.327369 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:22.253871    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:22.497700 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:22.354071    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:22.497700 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:22.454549    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:22.554737 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:22.554707    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:22.655367 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:22.655336    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:22.756146 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:22.756049    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Jul 10 18:58:22.804393 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.804221    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:22.843294 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.843265    2579 apiserver.go:52] "Watching apiserver"
Jul 10 18:58:22.855134 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.855107    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 18:58:22.855508 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.855473    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xxrhq","kube-system/konnectivity-agent-b5snc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8","openshift-image-registry/node-ca-zwmdv","openshift-multus/multus-additional-cni-plugins-b8xnz","openshift-multus/multus-c9glj","openshift-multus/network-metrics-daemon-w6cw9","openshift-network-diagnostics/network-check-target-sl68j","openshift-cluster-node-tuning-operator/tuned-cb96n","openshift-dns/node-resolver-z4g9f","openshift-network-operator/iptables-alerter-r4f4q","openshift-ovn-kubernetes/ovnkube-node-qs4gh"]
Jul 10 18:58:22.858874 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.858483    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:22.858874 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:22.858563    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:22.860773 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.860655    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:22.863120 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.863098    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:22.863282 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.863266    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 18:58:22.863391 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.863366    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4n8ln\""
Jul 10 18:58:22.863586 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.863569    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 18:58:22.866131 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.866109    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zwmdv"
Jul 10 18:58:22.866968 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.866907    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 18:58:22.866968 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.866967    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ld2n4\""
Jul 10 18:58:22.867191 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.866911    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 18:58:22.867191 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.867164    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 18:58:22.867870 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.867850    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:22.868868 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.868849    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 18:58:22.869591 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.869571    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 18:58:22.870571 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.870553    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 18:58:22.870868 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.870847    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:22.871397 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.871378    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.872185 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.871916    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 18:58:22.872185 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.871989    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 18:58:22.872185 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.871933    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jtvmh\""
Jul 10 18:58:22.872400 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.872385    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nchj8\""
Jul 10 18:58:22.873122 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.872836    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 18:58:22.873122 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.872909    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 18:58:22.873122 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.872957    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 18:58:22.873122 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.872916    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 18:58:22.873773 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.873737    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:22.873839 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:22.873812    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:22.874406 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.874385    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 18:58:22.875104 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.875064    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fdc8w\""
Jul 10 18:58:22.876482 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.876336    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:22.876482 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:22.876432    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:22.878739 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.878643    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:22.881207 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.881066    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4g9f"
Jul 10 18:58:22.882042 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.881851    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:58:22.882042 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.881917    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pv2jg\""
Jul 10 18:58:22.882201 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.882154    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 18:58:22.883553 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.883533    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8ckt8\""
Jul 10 18:58:22.883722 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.883701    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 18:58:22.884102 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.883850    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 18:58:22.884102 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.883919    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r4f4q"
Jul 10 18:58:22.886675 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.886627    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:22.887718 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.887699    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 18:58:22.887810 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.887754    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:58:22.888031 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.888014    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-clx9t\""
Jul 10 18:58:22.888273 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.888257    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 18:58:22.890536 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.890462    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 18:58:22.890670 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.890652    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 18:58:22.891674 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.891549    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"]
Jul 10 18:58:22.891674 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.891561    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 18:58:22.896094 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.896074    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 18:58:22.896542 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.896526    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 18:58:22.896967 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.896951    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2cx7z\""
Jul 10 18:58:22.897277 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.897263    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:58:22.897479 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.897462    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Jul 10 18:58:22.897968 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.897949    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.899822    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.899872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-system-cni-dir\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.899918    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4095efea-3030-4f10-878d-02894f3fa560-cni-binary-copy\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.899947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4095efea-3030-4f10-878d-02894f3fa560-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.899979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-var-lib-cni-bin\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900011    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-etc-selinux\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84297d76-89dd-4b8f-96a2-07271e721443-serviceca\") pod \"node-ca-zwmdv\" (UID: \"84297d76-89dd-4b8f-96a2-07271e721443\") " pod="openshift-image-registry/node-ca-zwmdv"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900101    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w677q\" (UniqueName: \"kubernetes.io/projected/03c8f640-6992-4fac-8c1d-802baf0a69d4-kube-api-access-w677q\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-os-release\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n526\" (UniqueName: \"kubernetes.io/projected/4095efea-3030-4f10-878d-02894f3fa560-kube-api-access-2n526\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900204    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-run-k8s-cni-cncf-io\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-hostroot\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-dbus\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-registration-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900327    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbr29\" (UniqueName: \"kubernetes.io/projected/84297d76-89dd-4b8f-96a2-07271e721443-kube-api-access-nbr29\") pod \"node-ca-zwmdv\" (UID: \"84297d76-89dd-4b8f-96a2-07271e721443\") " pod="openshift-image-registry/node-ca-zwmdv"
Jul 10 18:58:22.900477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-cni-dir\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-var-lib-cni-multus\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-sys-fs\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84297d76-89dd-4b8f-96a2-07271e721443-host\") pod \"node-ca-zwmdv\" (UID: \"84297d76-89dd-4b8f-96a2-07271e721443\") " pod="openshift-image-registry/node-ca-zwmdv"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-system-cni-dir\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-socket-dir-parent\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-run-netns\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-conf-dir\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-etc-kubernetes\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-device-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-kubelet-config\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.900985    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4095efea-3030-4f10-878d-02894f3fa560-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fba4c91f-93c0-48ed-afa2-82d46cf48965-cni-binary-copy\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901103    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-var-lib-kubelet\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.901267 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sndrp\" (UniqueName: \"kubernetes.io/projected/fba4c91f-93c0-48ed-afa2-82d46cf48965-kube-api-access-sndrp\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.902018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c54q\" (UniqueName: \"kubernetes.io/projected/9d330444-cee8-4d99-8930-5238cf432c77-kube-api-access-6c54q\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:22.902018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-cnibin\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:22.902018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-run-multus-certs\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.902018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-socket-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:22.902018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1e17b26-f350-4ea8-b77d-d3b5737f033d-agent-certs\") pod \"konnectivity-agent-b5snc\" (UID: \"d1e17b26-f350-4ea8-b77d-d3b5737f033d\") " pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:22.902018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-cnibin\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.902018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-daemon-config\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.902018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1e17b26-f350-4ea8-b77d-d3b5737f033d-konnectivity-ca\") pod \"konnectivity-agent-b5snc\" (UID: \"d1e17b26-f350-4ea8-b77d-d3b5737f033d\") " pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:22.902018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901706    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:22.902018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901778    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-os-release\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:22.902018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.901805    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 18:58:22.920278 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.920192    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 18:58:22.920572 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.920482    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"]
Jul 10 18:58:22.927888 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.927817    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qlvpn"
Jul 10 18:58:22.941869 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.941732    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qlvpn"
Jul 10 18:58:22.971889 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:22.971830    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 18:58:23.002202 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-lib-modules\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.002202 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-kubelet-config\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4095efea-3030-4f10-878d-02894f3fa560-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-tuned\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-slash\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-run-openvswitch\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002350    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-kubelet-config\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-ovn-node-metrics-cert\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-run-multus-certs\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8txh\" (UniqueName: \"kubernetes.io/projected/7387df1d-ca1e-43e5-8092-9dc2a2e00328-kube-api-access-g8txh\") pod \"node-resolver-z4g9f\" (UID: \"7387df1d-ca1e-43e5-8092-9dc2a2e00328\") " pod="openshift-dns/node-resolver-z4g9f"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-cnibin\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-run-multus-certs\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1e17b26-f350-4ea8-b77d-d3b5737f033d-konnectivity-ca\") pod \"konnectivity-agent-b5snc\" (UID: \"d1e17b26-f350-4ea8-b77d-d3b5737f033d\") " pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-os-release\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002568    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-cnibin\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002623    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-os-release\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-sysctl-d\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.003045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002667    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-sys\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-host\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-etc-openvswitch\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002738    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-run-ovn\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002741    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002783    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-system-cni-dir\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4095efea-3030-4f10-878d-02894f3fa560-cni-binary-copy\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-var-lib-cni-bin\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-run-netns\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-system-cni-dir\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002893    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-var-lib-openvswitch\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-var-lib-cni-bin\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-log-socket\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.002986    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8fdt\" (UniqueName: \"kubernetes.io/projected/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-kube-api-access-s8fdt\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4095efea-3030-4f10-878d-02894f3fa560-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-etc-selinux\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84297d76-89dd-4b8f-96a2-07271e721443-serviceca\") pod \"node-ca-zwmdv\" (UID: \"84297d76-89dd-4b8f-96a2-07271e721443\") " pod="openshift-image-registry/node-ca-zwmdv"
Jul 10 18:58:23.003901 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-os-release\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n526\" (UniqueName: \"kubernetes.io/projected/4095efea-3030-4f10-878d-02894f3fa560-kube-api-access-2n526\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-etc-selinux\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003185    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1e17b26-f350-4ea8-b77d-d3b5737f033d-konnectivity-ca\") pod \"konnectivity-agent-b5snc\" (UID: \"d1e17b26-f350-4ea8-b77d-d3b5737f033d\") " pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-run-k8s-cni-cncf-io\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-sysctl-conf\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-os-release\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0302519c-fb53-4e90-9c57-c52c79d757b5-iptables-alerter-script\") pod \"iptables-alerter-r4f4q\" (UID: \"0302519c-fb53-4e90-9c57-c52c79d757b5\") " pod="openshift-network-operator/iptables-alerter-r4f4q"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-run-k8s-cni-cncf-io\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003379    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4095efea-3030-4f10-878d-02894f3fa560-cni-binary-copy\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jkjf\" (UniqueName: \"kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf\") pod \"network-check-target-sl68j\" (UID: \"c230e79e-35d4-49e0-b95c-1c994f296ba5\") " pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-cni-dir\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-var-lib-kubelet\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7387df1d-ca1e-43e5-8092-9dc2a2e00328-tmp-dir\") pod \"node-resolver-z4g9f\" (UID: \"7387df1d-ca1e-43e5-8092-9dc2a2e00328\") " pod="openshift-dns/node-resolver-z4g9f"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-run-systemd\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84297d76-89dd-4b8f-96a2-07271e721443-serviceca\") pod \"node-ca-zwmdv\" (UID: \"84297d76-89dd-4b8f-96a2-07271e721443\") " pod="openshift-image-registry/node-ca-zwmdv"
Jul 10 18:58:23.004671 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.003621    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-run-ovn-kubernetes\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.003714    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs podName:03c8f640-6992-4fac-8c1d-802baf0a69d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:23.503673679 +0000 UTC m=+2.960224041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs") pod "network-metrics-daemon-w6cw9" (UID: "03c8f640-6992-4fac-8c1d-802baf0a69d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003724    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003750    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-cni-dir\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-system-cni-dir\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-socket-dir-parent\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-conf-dir\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003818    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-system-cni-dir\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-modprobe-d\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsd2h\" (UniqueName: \"kubernetes.io/projected/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-kube-api-access-xsd2h\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-conf-dir\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-socket-dir-parent\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-device-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fba4c91f-93c0-48ed-afa2-82d46cf48965-cni-binary-copy\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003927    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-device-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.005386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-var-lib-kubelet\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-systemd\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld4bn\" (UniqueName: \"kubernetes.io/projected/0302519c-fb53-4e90-9c57-c52c79d757b5-kube-api-access-ld4bn\") pod \"iptables-alerter-r4f4q\" (UID: \"0302519c-fb53-4e90-9c57-c52c79d757b5\") " pod="openshift-network-operator/iptables-alerter-r4f4q"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.003998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-var-lib-kubelet\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c54q\" (UniqueName: \"kubernetes.io/projected/9d330444-cee8-4d99-8930-5238cf432c77-kube-api-access-6c54q\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-cnibin\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0302519c-fb53-4e90-9c57-c52c79d757b5-host-slash\") pod \"iptables-alerter-r4f4q\" (UID: \"0302519c-fb53-4e90-9c57-c52c79d757b5\") " pod="openshift-network-operator/iptables-alerter-r4f4q"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-systemd-units\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4095efea-3030-4f10-878d-02894f3fa560-cnibin\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-cni-netd\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-socket-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1e17b26-f350-4ea8-b77d-d3b5737f033d-agent-certs\") pod \"konnectivity-agent-b5snc\" (UID: \"d1e17b26-f350-4ea8-b77d-d3b5737f033d\") " pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-daemon-config\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-tmp\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-kubelet\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-cni-bin\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.006123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4095efea-3030-4f10-878d-02894f3fa560-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-socket-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-kubernetes\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-node-log\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-ovnkube-config\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w677q\" (UniqueName: \"kubernetes.io/projected/03c8f640-6992-4fac-8c1d-802baf0a69d4-kube-api-access-w677q\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fba4c91f-93c0-48ed-afa2-82d46cf48965-cni-binary-copy\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-hostroot\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-env-overrides\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-ovnkube-script-lib\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004572    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.004606    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-dbus\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-registration-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.004651    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret podName:b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:23.504635052 +0000 UTC m=+2.961185409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret") pod "global-pull-secret-syncer-xxrhq" (UID: "b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbr29\" (UniqueName: \"kubernetes.io/projected/84297d76-89dd-4b8f-96a2-07271e721443-kube-api-access-nbr29\") pod \"node-ca-zwmdv\" (UID: \"84297d76-89dd-4b8f-96a2-07271e721443\") " pod="openshift-image-registry/node-ca-zwmdv"
Jul 10 18:58:23.006951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004693    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-registration-dir\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004706    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-var-lib-cni-multus\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7387df1d-ca1e-43e5-8092-9dc2a2e00328-hosts-file\") pod \"node-resolver-z4g9f\" (UID: \"7387df1d-ca1e-43e5-8092-9dc2a2e00328\") " pod="openshift-dns/node-resolver-z4g9f"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004741    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-hostroot\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fba4c91f-93c0-48ed-afa2-82d46cf48965-multus-daemon-config\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004840    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-var-lib-cni-multus\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-dbus\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004866    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-sys-fs\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4095efea-3030-4f10-878d-02894f3fa560-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84297d76-89dd-4b8f-96a2-07271e721443-host\") pod \"node-ca-zwmdv\" (UID: \"84297d76-89dd-4b8f-96a2-07271e721443\") " pod="openshift-image-registry/node-ca-zwmdv"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004944    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d330444-cee8-4d99-8930-5238cf432c77-sys-fs\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-run-netns\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004984    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84297d76-89dd-4b8f-96a2-07271e721443-host\") pod \"node-ca-zwmdv\" (UID: \"84297d76-89dd-4b8f-96a2-07271e721443\") " pod="openshift-image-registry/node-ca-zwmdv"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.004986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-etc-kubernetes\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.005005    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-host-run-netns\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.005030    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fba4c91f-93c0-48ed-afa2-82d46cf48965-etc-kubernetes\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.005041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sndrp\" (UniqueName: \"kubernetes.io/projected/fba4c91f-93c0-48ed-afa2-82d46cf48965-kube-api-access-sndrp\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.005081    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-sysconfig\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.007818 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.005106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-run\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.009937 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.009910    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1e17b26-f350-4ea8-b77d-d3b5737f033d-agent-certs\") pod \"konnectivity-agent-b5snc\" (UID: \"d1e17b26-f350-4ea8-b77d-d3b5737f033d\") " pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:23.014543 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.014518    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n526\" (UniqueName: \"kubernetes.io/projected/4095efea-3030-4f10-878d-02894f3fa560-kube-api-access-2n526\") pod \"multus-additional-cni-plugins-b8xnz\" (UID: \"4095efea-3030-4f10-878d-02894f3fa560\") " pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.016282 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.016235    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbr29\" (UniqueName: \"kubernetes.io/projected/84297d76-89dd-4b8f-96a2-07271e721443-kube-api-access-nbr29\") pod \"node-ca-zwmdv\" (UID: \"84297d76-89dd-4b8f-96a2-07271e721443\") " pod="openshift-image-registry/node-ca-zwmdv"
Jul 10 18:58:23.016566 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.016544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w677q\" (UniqueName: \"kubernetes.io/projected/03c8f640-6992-4fac-8c1d-802baf0a69d4-kube-api-access-w677q\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:23.017290 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.017064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c54q\" (UniqueName: \"kubernetes.io/projected/9d330444-cee8-4d99-8930-5238cf432c77-kube-api-access-6c54q\") pod \"aws-ebs-csi-driver-node-l2qq8\" (UID: \"9d330444-cee8-4d99-8930-5238cf432c77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.017945 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.017924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sndrp\" (UniqueName: \"kubernetes.io/projected/fba4c91f-93c0-48ed-afa2-82d46cf48965-kube-api-access-sndrp\") pod \"multus-c9glj\" (UID: \"fba4c91f-93c0-48ed-afa2-82d46cf48965\") " pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.054979 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.054949    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:23.105467 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-tmp\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.105637 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-kubelet\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.105637 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-cni-bin\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.105637 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-kubernetes\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.105637 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105609    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-cni-bin\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.105637 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-kubelet\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.105903 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-node-log\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.105903 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105678    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-node-log\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.105903 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-ovnkube-config\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.105903 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105718    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-env-overrides\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.105903 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105729    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-kubernetes\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.105903 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-ovnkube-script-lib\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.105903 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105773    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7387df1d-ca1e-43e5-8092-9dc2a2e00328-hosts-file\") pod \"node-resolver-z4g9f\" (UID: \"7387df1d-ca1e-43e5-8092-9dc2a2e00328\") " pod="openshift-dns/node-resolver-z4g9f"
Jul 10 18:58:23.105903 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7387df1d-ca1e-43e5-8092-9dc2a2e00328-hosts-file\") pod \"node-resolver-z4g9f\" (UID: \"7387df1d-ca1e-43e5-8092-9dc2a2e00328\") " pod="openshift-dns/node-resolver-z4g9f"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-sysconfig\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-run\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.105990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-lib-modules\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-tuned\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-slash\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-run-openvswitch\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-ovn-node-metrics-cert\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8txh\" (UniqueName: \"kubernetes.io/projected/7387df1d-ca1e-43e5-8092-9dc2a2e00328-kube-api-access-g8txh\") pod \"node-resolver-z4g9f\" (UID: \"7387df1d-ca1e-43e5-8092-9dc2a2e00328\") " pod="openshift-dns/node-resolver-z4g9f"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-sysctl-d\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-sys\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-host\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-etc-openvswitch\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106266    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-env-overrides\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.106300 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-run-ovn\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-run-netns\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-ovnkube-config\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-run-openvswitch\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-var-lib-openvswitch\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-log-socket\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8fdt\" (UniqueName: \"kubernetes.io/projected/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-kube-api-access-s8fdt\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-sysctl-conf\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0302519c-fb53-4e90-9c57-c52c79d757b5-iptables-alerter-script\") pod \"iptables-alerter-r4f4q\" (UID: \"0302519c-fb53-4e90-9c57-c52c79d757b5\") " pod="openshift-network-operator/iptables-alerter-r4f4q"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-lib-modules\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106494    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkjf\" (UniqueName: \"kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf\") pod \"network-check-target-sl68j\" (UID: \"c230e79e-35d4-49e0-b95c-1c994f296ba5\") " pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106495    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-ovnkube-script-lib\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-var-lib-kubelet\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106539    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-sysconfig\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106564    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-slash\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7387df1d-ca1e-43e5-8092-9dc2a2e00328-tmp-dir\") pod \"node-resolver-z4g9f\" (UID: \"7387df1d-ca1e-43e5-8092-9dc2a2e00328\") " pod="openshift-dns/node-resolver-z4g9f"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106586    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-run\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.107061 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-run-systemd\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-run-netns\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-run-ovn-kubernetes\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-modprobe-d\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsd2h\" (UniqueName: \"kubernetes.io/projected/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-kube-api-access-xsd2h\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-systemd\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106754    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld4bn\" (UniqueName: \"kubernetes.io/projected/0302519c-fb53-4e90-9c57-c52c79d757b5-kube-api-access-ld4bn\") pod \"iptables-alerter-r4f4q\" (UID: \"0302519c-fb53-4e90-9c57-c52c79d757b5\") " pod="openshift-network-operator/iptables-alerter-r4f4q"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0302519c-fb53-4e90-9c57-c52c79d757b5-host-slash\") pod \"iptables-alerter-r4f4q\" (UID: \"0302519c-fb53-4e90-9c57-c52c79d757b5\") " pod="openshift-network-operator/iptables-alerter-r4f4q"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-systemd-units\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-cni-netd\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106876    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7387df1d-ca1e-43e5-8092-9dc2a2e00328-tmp-dir\") pod \"node-resolver-z4g9f\" (UID: \"7387df1d-ca1e-43e5-8092-9dc2a2e00328\") " pod="openshift-dns/node-resolver-z4g9f"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106941    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-run-systemd\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.106948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107008    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-run-ovn-kubernetes\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-modprobe-d\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107058    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-var-lib-openvswitch\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.107908 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0302519c-fb53-4e90-9c57-c52c79d757b5-host-slash\") pod \"iptables-alerter-r4f4q\" (UID: \"0302519c-fb53-4e90-9c57-c52c79d757b5\") " pod="openshift-network-operator/iptables-alerter-r4f4q"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107098    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-host-cni-netd\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107103    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-log-socket\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107140    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-systemd-units\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107228    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-sys\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-etc-openvswitch\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107349    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-sysctl-d\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107372    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-host\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-systemd\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-var-lib-kubelet\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107492    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-run-ovn\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-sysctl-conf\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.107778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0302519c-fb53-4e90-9c57-c52c79d757b5-iptables-alerter-script\") pod \"iptables-alerter-r4f4q\" (UID: \"0302519c-fb53-4e90-9c57-c52c79d757b5\") " pod="openshift-network-operator/iptables-alerter-r4f4q"
Jul 10 18:58:23.108771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.108480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-tmp\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.109733 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.109655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-etc-tuned\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.110710 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.110626    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-ovn-node-metrics-cert\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.113343 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.113321    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:23.113461 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.113347    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:23.113461 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.113362    2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jkjf for pod openshift-network-diagnostics/network-check-target-sl68j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:23.113461 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.113453    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf podName:c230e79e-35d4-49e0-b95c-1c994f296ba5 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:23.613432774 +0000 UTC m=+3.069983150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2jkjf" (UniqueName: "kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf") pod "network-check-target-sl68j" (UID: "c230e79e-35d4-49e0-b95c-1c994f296ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:23.115889 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.115841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8txh\" (UniqueName: \"kubernetes.io/projected/7387df1d-ca1e-43e5-8092-9dc2a2e00328-kube-api-access-g8txh\") pod \"node-resolver-z4g9f\" (UID: \"7387df1d-ca1e-43e5-8092-9dc2a2e00328\") " pod="openshift-dns/node-resolver-z4g9f"
Jul 10 18:58:23.117937 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.117606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld4bn\" (UniqueName: \"kubernetes.io/projected/0302519c-fb53-4e90-9c57-c52c79d757b5-kube-api-access-ld4bn\") pod \"iptables-alerter-r4f4q\" (UID: \"0302519c-fb53-4e90-9c57-c52c79d757b5\") " pod="openshift-network-operator/iptables-alerter-r4f4q"
Jul 10 18:58:23.117937 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.117744    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8fdt\" (UniqueName: \"kubernetes.io/projected/ce8d7b43-bcf9-495a-9b4b-503fb697e8e5-kube-api-access-s8fdt\") pod \"ovnkube-node-qs4gh\" (UID: \"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.118419 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.118375    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsd2h\" (UniqueName: \"kubernetes.io/projected/d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee-kube-api-access-xsd2h\") pod \"tuned-cb96n\" (UID: \"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee\") " pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.125514 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.125455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal" event={"ID":"d4bca704f227a6e54773cc110a279cbf","Type":"ContainerStarted","Data":"4fbf466c89de1f18c087960196c8148c202bfd8b1854c07116793dba58d07c6e"}
Jul 10 18:58:23.126879 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.126850    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal" event={"ID":"852848d9a6955f404681b7955865ce86","Type":"ContainerStarted","Data":"fea834334c2e57c8b82e6b8f45fb07237a3ef137734aeadcfc2a67eb114b1f4a"}
Jul 10 18:58:23.180305 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.180280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:23.186350 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.186327    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8"
Jul 10 18:58:23.202167 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.202141    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zwmdv"
Jul 10 18:58:23.210290 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.210270    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b8xnz"
Jul 10 18:58:23.220218 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.220197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c9glj"
Jul 10 18:58:23.228998 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.228977    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cb96n"
Jul 10 18:58:23.234035 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.234016    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 18:58:23.237245 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.237228    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4g9f"
Jul 10 18:58:23.249006 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.248986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r4f4q"
Jul 10 18:58:23.254761 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.254738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:23.509874 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.509791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:23.510024 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.509887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:23.510024 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.509968    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:23.510024 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.509981    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:23.510174 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.510034    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs podName:03c8f640-6992-4fac-8c1d-802baf0a69d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:24.510017411 +0000 UTC m=+3.966567769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs") pod "network-metrics-daemon-w6cw9" (UID: "03c8f640-6992-4fac-8c1d-802baf0a69d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:23.510174 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.510056    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret podName:b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:24.510046187 +0000 UTC m=+3.966596558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret") pod "global-pull-secret-syncer-xxrhq" (UID: "b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:23.711345 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.711313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkjf\" (UniqueName: \"kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf\") pod \"network-check-target-sl68j\" (UID: \"c230e79e-35d4-49e0-b95c-1c994f296ba5\") " pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:23.711538 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.711505    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:23.711538 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.711529    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:23.711649 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.711544    2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jkjf for pod openshift-network-diagnostics/network-check-target-sl68j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:23.711649 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:23.711603    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf podName:c230e79e-35d4-49e0-b95c-1c994f296ba5 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:24.71158668 +0000 UTC m=+4.168137043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jkjf" (UniqueName: "kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf") pod "network-check-target-sl68j" (UID: "c230e79e-35d4-49e0-b95c-1c994f296ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:23.945940 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.945856    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:53:22 +0000 UTC" deadline="2027-12-04 18:01:12.572517036 +0000 UTC"
Jul 10 18:58:23.945940 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:23.945886    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12287h2m48.626634089s"
Jul 10 18:58:24.095871 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:24.095836    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4095efea_3030_4f10_878d_02894f3fa560.slice/crio-e49a97fbc1b3208e7ba270cfcf64b20f201ff7b93519401f324ea62be1b95d4e WatchSource:0}: Error finding container e49a97fbc1b3208e7ba270cfcf64b20f201ff7b93519401f324ea62be1b95d4e: Status 404 returned error can't find the container with id e49a97fbc1b3208e7ba270cfcf64b20f201ff7b93519401f324ea62be1b95d4e
Jul 10 18:58:24.099533 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:24.099506    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7387df1d_ca1e_43e5_8092_9dc2a2e00328.slice/crio-e6631165bd1a8a203e3a4c945402787e1478b35400a8b159ab0547c472039d12 WatchSource:0}: Error finding container e6631165bd1a8a203e3a4c945402787e1478b35400a8b159ab0547c472039d12: Status 404 returned error can't find the container with id e6631165bd1a8a203e3a4c945402787e1478b35400a8b159ab0547c472039d12
Jul 10 18:58:24.103265 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:24.103243    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d330444_cee8_4d99_8930_5238cf432c77.slice/crio-0fa57b9e87a21b7563c034d0fb2f672338b31114e1e20e237d6b8cbbf5e0aca5 WatchSource:0}: Error finding container 0fa57b9e87a21b7563c034d0fb2f672338b31114e1e20e237d6b8cbbf5e0aca5: Status 404 returned error can't find the container with id 0fa57b9e87a21b7563c034d0fb2f672338b31114e1e20e237d6b8cbbf5e0aca5
Jul 10 18:58:24.106945 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:24.106923    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce8d7b43_bcf9_495a_9b4b_503fb697e8e5.slice/crio-146b9fc83e3b2dcab41964ad92957e2cdb1e6fcc584aa6d63cc61257645e8ee8 WatchSource:0}: Error finding container 146b9fc83e3b2dcab41964ad92957e2cdb1e6fcc584aa6d63cc61257645e8ee8: Status 404 returned error can't find the container with id 146b9fc83e3b2dcab41964ad92957e2cdb1e6fcc584aa6d63cc61257645e8ee8
Jul 10 18:58:24.107202 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:24.107180    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42f4f1b_b038_4d5b_b064_5f2b0e7ee3ee.slice/crio-cba5bf80772ed19beb7fcaa2375bdb59ca16cfe7809a7a3c057aec9ee420ea1c WatchSource:0}: Error finding container cba5bf80772ed19beb7fcaa2375bdb59ca16cfe7809a7a3c057aec9ee420ea1c: Status 404 returned error can't find the container with id cba5bf80772ed19beb7fcaa2375bdb59ca16cfe7809a7a3c057aec9ee420ea1c
Jul 10 18:58:24.108662 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:24.108643    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e17b26_f350_4ea8_b77d_d3b5737f033d.slice/crio-f81fbe608658754678950e35f06c27a9cffc77184d817c4626d3de3eefae2ff6 WatchSource:0}: Error finding container f81fbe608658754678950e35f06c27a9cffc77184d817c4626d3de3eefae2ff6: Status 404 returned error can't find the container with id f81fbe608658754678950e35f06c27a9cffc77184d817c4626d3de3eefae2ff6
Jul 10 18:58:24.110893 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:24.110860    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84297d76_89dd_4b8f_96a2_07271e721443.slice/crio-7f9befb5224e34d32f50e7a0977e0796a8fd213408eb98aa5ba28bd08c85c2c8 WatchSource:0}: Error finding container 7f9befb5224e34d32f50e7a0977e0796a8fd213408eb98aa5ba28bd08c85c2c8: Status 404 returned error can't find the container with id 7f9befb5224e34d32f50e7a0977e0796a8fd213408eb98aa5ba28bd08c85c2c8
Jul 10 18:58:24.112245 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:24.112222    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba4c91f_93c0_48ed_afa2_82d46cf48965.slice/crio-6e25c2d648c1701d0cc37c74148c3b46dd2084d124d674576d0852f579c6d729 WatchSource:0}: Error finding container 6e25c2d648c1701d0cc37c74148c3b46dd2084d124d674576d0852f579c6d729: Status 404 returned error can't find the container with id 6e25c2d648c1701d0cc37c74148c3b46dd2084d124d674576d0852f579c6d729
Jul 10 18:58:24.113359 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:24.113343    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0302519c_fb53_4e90_9c57_c52c79d757b5.slice/crio-db2ae77bf1e6a082079e4445625624f4ccab4d8b168fb357b278a81fd7be87eb WatchSource:0}: Error finding container db2ae77bf1e6a082079e4445625624f4ccab4d8b168fb357b278a81fd7be87eb: Status 404 returned error can't find the container with id db2ae77bf1e6a082079e4445625624f4ccab4d8b168fb357b278a81fd7be87eb
Jul 10 18:58:24.116827 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.116805    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:24.116912 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:24.116895    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:24.116952 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.116925    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:24.117003 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:24.116972    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:24.129892 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.129866    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh" event={"ID":"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5","Type":"ContainerStarted","Data":"146b9fc83e3b2dcab41964ad92957e2cdb1e6fcc584aa6d63cc61257645e8ee8"}
Jul 10 18:58:24.130963 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.130939    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4g9f" event={"ID":"7387df1d-ca1e-43e5-8092-9dc2a2e00328","Type":"ContainerStarted","Data":"e6631165bd1a8a203e3a4c945402787e1478b35400a8b159ab0547c472039d12"}
Jul 10 18:58:24.132007 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.131983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r4f4q" event={"ID":"0302519c-fb53-4e90-9c57-c52c79d757b5","Type":"ContainerStarted","Data":"db2ae77bf1e6a082079e4445625624f4ccab4d8b168fb357b278a81fd7be87eb"}
Jul 10 18:58:24.132969 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.132951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cb96n" event={"ID":"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee","Type":"ContainerStarted","Data":"cba5bf80772ed19beb7fcaa2375bdb59ca16cfe7809a7a3c057aec9ee420ea1c"}
Jul 10 18:58:24.133852 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.133834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8" event={"ID":"9d330444-cee8-4d99-8930-5238cf432c77","Type":"ContainerStarted","Data":"0fa57b9e87a21b7563c034d0fb2f672338b31114e1e20e237d6b8cbbf5e0aca5"}
Jul 10 18:58:24.135004 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.134892    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8xnz" event={"ID":"4095efea-3030-4f10-878d-02894f3fa560","Type":"ContainerStarted","Data":"e49a97fbc1b3208e7ba270cfcf64b20f201ff7b93519401f324ea62be1b95d4e"}
Jul 10 18:58:24.136006 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.135978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c9glj" event={"ID":"fba4c91f-93c0-48ed-afa2-82d46cf48965","Type":"ContainerStarted","Data":"6e25c2d648c1701d0cc37c74148c3b46dd2084d124d674576d0852f579c6d729"}
Jul 10 18:58:24.137590 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.137483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zwmdv" event={"ID":"84297d76-89dd-4b8f-96a2-07271e721443","Type":"ContainerStarted","Data":"7f9befb5224e34d32f50e7a0977e0796a8fd213408eb98aa5ba28bd08c85c2c8"}
Jul 10 18:58:24.138540 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.138517    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b5snc" event={"ID":"d1e17b26-f350-4ea8-b77d-d3b5737f033d","Type":"ContainerStarted","Data":"f81fbe608658754678950e35f06c27a9cffc77184d817c4626d3de3eefae2ff6"}
Jul 10 18:58:24.517293 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.516986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:24.517293 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.517272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:24.517523 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:24.517415    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:24.517523 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:24.517474    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret podName:b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:26.517456219 +0000 UTC m=+5.974006589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret") pod "global-pull-secret-syncer-xxrhq" (UID: "b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:24.517856 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:24.517828    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:24.517915 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:24.517888    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs podName:03c8f640-6992-4fac-8c1d-802baf0a69d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:26.517873523 +0000 UTC m=+5.974423885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs") pod "network-metrics-daemon-w6cw9" (UID: "03c8f640-6992-4fac-8c1d-802baf0a69d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:24.719216 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.719181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkjf\" (UniqueName: \"kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf\") pod \"network-check-target-sl68j\" (UID: \"c230e79e-35d4-49e0-b95c-1c994f296ba5\") " pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:24.719424 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:24.719406    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:24.719492 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:24.719463    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:24.719492 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:24.719476    2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jkjf for pod openshift-network-diagnostics/network-check-target-sl68j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:24.719588 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:24.719531    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf podName:c230e79e-35d4-49e0-b95c-1c994f296ba5 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:26.719513296 +0000 UTC m=+6.176063675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jkjf" (UniqueName: "kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf") pod "network-check-target-sl68j" (UID: "c230e79e-35d4-49e0-b95c-1c994f296ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:24.946567 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.946273    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:53:22 +0000 UTC" deadline="2028-03-29 16:02:57.40164339 +0000 UTC"
Jul 10 18:58:24.946567 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:24.946308    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15069h4m32.455339397s"
Jul 10 18:58:25.130122 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:25.130056    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:25.130570 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:25.130239    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:25.155805 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:25.155772    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal" event={"ID":"852848d9a6955f404681b7955865ce86","Type":"ContainerStarted","Data":"47e99bfb2103a82caf62aff68cc900ba33ab2f5f6a5e1f87cb9ce32efaf63c9c"}
Jul 10 18:58:25.168815 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:25.168781    2579 generic.go:356] "Generic (PLEG): container finished" podID="d4bca704f227a6e54773cc110a279cbf" containerID="ee48cd40a4d0162ae06500009f83fda27d102228ef4244f5dbda0dbf2a8ec45f" exitCode=0
Jul 10 18:58:25.168970 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:25.168826    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal" event={"ID":"d4bca704f227a6e54773cc110a279cbf","Type":"ContainerDied","Data":"ee48cd40a4d0162ae06500009f83fda27d102228ef4244f5dbda0dbf2a8ec45f"}
Jul 10 18:58:25.199610 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:25.198856    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal" podStartSLOduration=3.198835266 podStartE2EDuration="3.198835266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:25.184349396 +0000 UTC m=+4.640899793" watchObservedRunningTime="2026-07-10 18:58:25.198835266 +0000 UTC m=+4.655385657"
Jul 10 18:58:26.117315 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:26.116852    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:26.117315 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:26.116894    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:26.117315 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:26.116989    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:26.117315 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:26.117106    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:26.187792 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:26.187723    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal" event={"ID":"d4bca704f227a6e54773cc110a279cbf","Type":"ContainerStarted","Data":"1d96a7d38c6057e7d03268d8e6fcd5252a785f214f22c0937e74519d1df154f0"}
Jul 10 18:58:26.542912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:26.542241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:26.542912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:26.542325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:26.542912 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:26.542472    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:26.542912 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:26.542528    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs podName:03c8f640-6992-4fac-8c1d-802baf0a69d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:30.542510895 +0000 UTC m=+9.999061265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs") pod "network-metrics-daemon-w6cw9" (UID: "03c8f640-6992-4fac-8c1d-802baf0a69d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:26.542912 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:26.542531    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:26.542912 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:26.542592    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret podName:b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:30.542575473 +0000 UTC m=+9.999125833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret") pod "global-pull-secret-syncer-xxrhq" (UID: "b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:26.744466 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:26.744409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkjf\" (UniqueName: \"kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf\") pod \"network-check-target-sl68j\" (UID: \"c230e79e-35d4-49e0-b95c-1c994f296ba5\") " pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:26.744646 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:26.744564    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:26.744646 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:26.744591    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:26.744646 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:26.744604    2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jkjf for pod openshift-network-diagnostics/network-check-target-sl68j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:26.744799 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:26.744665    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf podName:c230e79e-35d4-49e0-b95c-1c994f296ba5 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:30.744646277 +0000 UTC m=+10.201196647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jkjf" (UniqueName: "kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf") pod "network-check-target-sl68j" (UID: "c230e79e-35d4-49e0-b95c-1c994f296ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:27.116910 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:27.116874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:27.117092 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:27.117037    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:28.116881 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:28.116841    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:28.117315 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:28.116977    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:28.117315 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:28.117070    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:28.117315 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:28.117176    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:29.117495 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:29.117462    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:29.117893 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:29.117605    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:30.117142 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:30.117101    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:30.117331 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:30.117150    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:30.117331 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:30.117233    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:30.117430 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:30.117358    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:30.578466 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:30.578364    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:30.578466 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:30.578446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:30.578855 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:30.578570    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:30.578855 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:30.578629    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret podName:b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:38.578612278 +0000 UTC m=+18.035162638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret") pod "global-pull-secret-syncer-xxrhq" (UID: "b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:30.579119 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:30.579036    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:30.579119 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:30.579088    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs podName:03c8f640-6992-4fac-8c1d-802baf0a69d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:38.579072876 +0000 UTC m=+18.035623237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs") pod "network-metrics-daemon-w6cw9" (UID: "03c8f640-6992-4fac-8c1d-802baf0a69d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:30.780588 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:30.780555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkjf\" (UniqueName: \"kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf\") pod \"network-check-target-sl68j\" (UID: \"c230e79e-35d4-49e0-b95c-1c994f296ba5\") " pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:30.780772 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:30.780725    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:30.780772 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:30.780744    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:30.780772 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:30.780756    2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jkjf for pod openshift-network-diagnostics/network-check-target-sl68j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:30.780924 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:30.780818    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf podName:c230e79e-35d4-49e0-b95c-1c994f296ba5 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:38.780799479 +0000 UTC m=+18.237349851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jkjf" (UniqueName: "kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf") pod "network-check-target-sl68j" (UID: "c230e79e-35d4-49e0-b95c-1c994f296ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:31.117869 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:31.117711    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:31.117869 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:31.117830    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:32.116953 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:32.116918    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:32.117423 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:32.117047    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:32.117639 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:32.117497    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:32.117639 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:32.117592    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:33.117112 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:33.117061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:33.117561 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:33.117245    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:34.117680 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:34.117638    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:34.118133 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:34.117645    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:34.118133 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:34.117771    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:34.118133 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:34.117809    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:35.116912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:35.116842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:35.117053 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:35.116955    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:36.117616 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:36.117586    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:36.118040 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:36.117586    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:36.118040 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:36.117703    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:36.118040 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:36.117800    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:37.117716 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:37.117680    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:37.118177 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:37.117830    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:38.117599 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:38.117448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:38.117821 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:38.117601    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:38.117821 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:38.117596    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:38.117821 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:38.117703    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:38.641184 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:38.641150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:38.641389 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:38.641233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:38.641389 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:38.641323    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:38.641527 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:38.641410    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret podName:b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:54.641394155 +0000 UTC m=+34.097944525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret") pod "global-pull-secret-syncer-xxrhq" (UID: "b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:38.641527 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:38.641330    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:38.641527 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:38.641494    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs podName:03c8f640-6992-4fac-8c1d-802baf0a69d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:54.64147472 +0000 UTC m=+34.098025096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs") pod "network-metrics-daemon-w6cw9" (UID: "03c8f640-6992-4fac-8c1d-802baf0a69d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:38.842712 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:38.842670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkjf\" (UniqueName: \"kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf\") pod \"network-check-target-sl68j\" (UID: \"c230e79e-35d4-49e0-b95c-1c994f296ba5\") " pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:38.842878 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:38.842839    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:38.842878 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:38.842860    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:38.842878 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:38.842874    2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jkjf for pod openshift-network-diagnostics/network-check-target-sl68j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:38.843018 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:38.842927    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf podName:c230e79e-35d4-49e0-b95c-1c994f296ba5 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:54.842913525 +0000 UTC m=+34.299463886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jkjf" (UniqueName: "kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf") pod "network-check-target-sl68j" (UID: "c230e79e-35d4-49e0-b95c-1c994f296ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:39.117128 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:39.117040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:39.117278 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:39.117166    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:40.116735 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:40.116697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:40.117136 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:40.116824    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:40.117136 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:40.116860    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:40.117136 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:40.116922    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:41.117945 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:41.117909    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:41.118422 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:41.118016    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:42.117681 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:42.117652    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:42.117876 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:42.117751    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:42.117876 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:42.117812    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:42.117992 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:42.117928    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:43.117104 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.116827    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:43.117297 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:43.117222    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:43.222590 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.222559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c9glj" event={"ID":"fba4c91f-93c0-48ed-afa2-82d46cf48965","Type":"ContainerStarted","Data":"c999a7d260e99b1d20daf92a586b3d6a99a5d0491f31fd92235d5edf4a93bfba"}
Jul 10 18:58:43.224149 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.224128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zwmdv" event={"ID":"84297d76-89dd-4b8f-96a2-07271e721443","Type":"ContainerStarted","Data":"f61821d1a411a64e4cae3b8e0009836e9903591153728efb99c526483af6873d"}
Jul 10 18:58:43.225681 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.225657    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b5snc" event={"ID":"d1e17b26-f350-4ea8-b77d-d3b5737f033d","Type":"ContainerStarted","Data":"1d1666b4dfd9b10c404bd686d8aa2e0de23d6851a08766d6021df4f0c6e34143"}
Jul 10 18:58:43.230929 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.230907    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 18:58:43.231286 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.231258    2579 generic.go:356] "Generic (PLEG): container finished" podID="ce8d7b43-bcf9-495a-9b4b-503fb697e8e5" containerID="34b7a9265cea6ad888ec21b0ec9acd96a7b6e8ac7839fee454abc0ddd2eefbe9" exitCode=1
Jul 10 18:58:43.231404 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.231338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh" event={"ID":"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5","Type":"ContainerStarted","Data":"6fbab6e1f05337a3c775e746ed3b43cb2fc4814787fb7c0602c95605a410d0ba"}
Jul 10 18:58:43.231473 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.231458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh" event={"ID":"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5","Type":"ContainerStarted","Data":"e26b8fa2f93657e5193361e954510ff51fc6e639ad30caac462cfc1b117a9abe"}
Jul 10 18:58:43.231524 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.231509    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh" event={"ID":"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5","Type":"ContainerDied","Data":"34b7a9265cea6ad888ec21b0ec9acd96a7b6e8ac7839fee454abc0ddd2eefbe9"}
Jul 10 18:58:43.231568 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.231548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh" event={"ID":"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5","Type":"ContainerStarted","Data":"858273c7fcf498fbec9afc2ac3b1c3fa3fe51b2681765ddca5e8cfbaab9097c8"}
Jul 10 18:58:43.232996 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.232974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4g9f" event={"ID":"7387df1d-ca1e-43e5-8092-9dc2a2e00328","Type":"ContainerStarted","Data":"534abc4e501b0da22cfc8a1a4ec14c883945e3c86df6f21982628907829e347d"}
Jul 10 18:58:43.234772 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.234640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cb96n" event={"ID":"d42f4f1b-b038-4d5b-b064-5f2b0e7ee3ee","Type":"ContainerStarted","Data":"7d9666288423068b83f69aca1ba4a9b5245d2467d043e09c9af3bdc5d1fd1f90"}
Jul 10 18:58:43.236643 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.236616    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8" event={"ID":"9d330444-cee8-4d99-8930-5238cf432c77","Type":"ContainerStarted","Data":"322011d000ba13cff848e22bff17960abfabb452209934fd1eb5c4abd9439470"}
Jul 10 18:58:43.238645 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.238623    2579 generic.go:356] "Generic (PLEG): container finished" podID="4095efea-3030-4f10-878d-02894f3fa560" containerID="446116cb852506419f09c9e9098b10dfc0d8be0acd07cbd65be5e80b0dc4cec3" exitCode=0
Jul 10 18:58:43.238725 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.238655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8xnz" event={"ID":"4095efea-3030-4f10-878d-02894f3fa560","Type":"ContainerDied","Data":"446116cb852506419f09c9e9098b10dfc0d8be0acd07cbd65be5e80b0dc4cec3"}
Jul 10 18:58:43.241950 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.241892    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal" podStartSLOduration=21.241879166 podStartE2EDuration="21.241879166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:26.203523448 +0000 UTC m=+5.660073826" watchObservedRunningTime="2026-07-10 18:58:43.241879166 +0000 UTC m=+22.698429544"
Jul 10 18:58:43.242464 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.242433    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c9glj" podStartSLOduration=3.779119846 podStartE2EDuration="22.242419679s" totalImagesPullingTime="18.463299833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:43.24200494 +0000 UTC m=+22.698555335" watchObservedRunningTime="2026-07-10 18:58:43.242419679 +0000 UTC m=+22.698970057"
Jul 10 18:58:43.279118 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.279080    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b5snc" podStartSLOduration=7.686799973 podStartE2EDuration="22.279067796s" totalImagesPullingTime="14.592267823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:43.257144727 +0000 UTC m=+22.713695105" watchObservedRunningTime="2026-07-10 18:58:43.279067796 +0000 UTC m=+22.735618177"
Jul 10 18:58:43.311959 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.311921    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cb96n" podStartSLOduration=3.861066692 podStartE2EDuration="22.311907996s" totalImagesPullingTime="18.450841304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:43.298063391 +0000 UTC m=+22.754613783" watchObservedRunningTime="2026-07-10 18:58:43.311907996 +0000 UTC m=+22.768458353"
Jul 10 18:58:43.312380 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.312344    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zwmdv" podStartSLOduration=3.944940291 podStartE2EDuration="22.312337813s" totalImagesPullingTime="18.367397522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:43.312056531 +0000 UTC m=+22.768606921" watchObservedRunningTime="2026-07-10 18:58:43.312337813 +0000 UTC m=+22.768888189"
Jul 10 18:58:43.328046 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.327999    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z4g9f" podStartSLOduration=3.8710765780000003 podStartE2EDuration="22.327980118s" totalImagesPullingTime="18.45690354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:43.327697039 +0000 UTC m=+22.784247417" watchObservedRunningTime="2026-07-10 18:58:43.327980118 +0000 UTC m=+22.784530498"
Jul 10 18:58:43.367175 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.367142    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:43.433943 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.433879    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:43.520765 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.520734    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:43.804412 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:43.804357    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 18:58:44.002710 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.002662    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:44.013052 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.012946    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T18:58:43.804395723Z","UUID":"3abd08a1-7ed7-46b0-b74a-2b1ab229adb1","Handler":null,"Name":"","Endpoint":""}
Jul 10 18:58:44.014530 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.014503    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 18:58:44.014635 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.014548    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 18:58:44.117343 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.117316    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:44.117577 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.117316    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:44.117577 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:44.117454    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:44.117577 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:44.117490    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:44.244726 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.244654    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 18:58:44.245274 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.245067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh" event={"ID":"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5","Type":"ContainerStarted","Data":"f1c6d4c1b542665b9bcd92787c30232e4bed0ba2de350def11c56e63056f06d8"}
Jul 10 18:58:44.245274 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.245160    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh" event={"ID":"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5","Type":"ContainerStarted","Data":"38232b87a12d6615480663869a865da42f47a4142619dbdca4bf4ab7466526a8"}
Jul 10 18:58:44.246668 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.246639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r4f4q" event={"ID":"0302519c-fb53-4e90-9c57-c52c79d757b5","Type":"ContainerStarted","Data":"7bab67e1ffb96a5232f9cc830e901c35619f35734a08e0d171022ce18172861c"}
Jul 10 18:58:44.248760 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.248734    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8" event={"ID":"9d330444-cee8-4d99-8930-5238cf432c77","Type":"ContainerStarted","Data":"6047eaeb1a80863fa93e22593436a9b7cf900b761cdf482b7faad35f0ebc2f4e"}
Jul 10 18:58:44.263049 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.263010    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r4f4q" podStartSLOduration=4.838858211 podStartE2EDuration="23.262997807s" totalImagesPullingTime="18.424139596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:44.262834269 +0000 UTC m=+23.719384646" watchObservedRunningTime="2026-07-10 18:58:44.262997807 +0000 UTC m=+23.719548185"
Jul 10 18:58:44.391193 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.391139    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:44.489036 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:44.489004    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:45.117597 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:45.117348    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:45.117744 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:45.117720    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:45.254125 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:45.254089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8" event={"ID":"9d330444-cee8-4d99-8930-5238cf432c77","Type":"ContainerStarted","Data":"515a5934bbde2bf8a42be63d153cee6838bd5b0ecd4c894494c371745a6b7729"}
Jul 10 18:58:45.272812 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:45.272724    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2qq8" podStartSLOduration=3.715865685 podStartE2EDuration="24.272710659s" totalImagesPullingTime="20.556844974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:45.271898323 +0000 UTC m=+24.728448695" watchObservedRunningTime="2026-07-10 18:58:45.272710659 +0000 UTC m=+24.729261061"
Jul 10 18:58:46.117237 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:46.117158    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:46.117237 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:46.117211    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:46.117459 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:46.117323    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:46.117502 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:46.117463    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:46.316793 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:46.316752    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:46.317424 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:46.317405    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:47.117398 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:47.117352    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:47.117550 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:47.117488    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:47.258345 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:47.258316    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:47.258853 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:47.258839    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b5snc"
Jul 10 18:58:47.323194 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:47.323164    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:48.117020 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:48.116992    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:48.117181 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:48.116992    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:48.117181 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:48.117089    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:48.117181 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:48.117147    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:48.263413 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:48.263386    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 18:58:48.263787 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:48.263754    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh" event={"ID":"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5","Type":"ContainerStarted","Data":"cfa3afc9abdda304eaee201c601c9d605be02d8967620ad9b40ff180c9e4d454"}
Jul 10 18:58:48.265382 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:48.265350    2579 generic.go:356] "Generic (PLEG): container finished" podID="4095efea-3030-4f10-878d-02894f3fa560" containerID="1247ba781fcc7aaa411046326b08fc7063a95c2aaafc8e1ef7120da3cdd39678" exitCode=0
Jul 10 18:58:48.265496 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:48.265429    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8xnz" event={"ID":"4095efea-3030-4f10-878d-02894f3fa560","Type":"ContainerDied","Data":"1247ba781fcc7aaa411046326b08fc7063a95c2aaafc8e1ef7120da3cdd39678"}
Jul 10 18:58:49.117767 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:49.117730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:49.118299 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:49.117888    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:50.117012 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:50.116833    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:50.117205 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:50.116833    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:50.117205 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:50.117086    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:50.117205 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:50.117161    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:50.272837 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:50.272810    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 18:58:50.273254 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:50.273219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh" event={"ID":"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5","Type":"ContainerStarted","Data":"4f24f631f6f19acf63f1ba182b215cfdb6b2580993c1b822e57737f8e68e9703"}
Jul 10 18:58:50.273433 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:50.273413    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:50.273689 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:50.273666    2579 scope.go:117] "RemoveContainer" containerID="34b7a9265cea6ad888ec21b0ec9acd96a7b6e8ac7839fee454abc0ddd2eefbe9"
Jul 10 18:58:50.275495 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:50.275472    2579 generic.go:356] "Generic (PLEG): container finished" podID="4095efea-3030-4f10-878d-02894f3fa560" containerID="c6e59997d39f55c143817979bf77324e0bfa3ce7acaba0c232c0d7e195571114" exitCode=0
Jul 10 18:58:50.275574 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:50.275521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8xnz" event={"ID":"4095efea-3030-4f10-878d-02894f3fa560","Type":"ContainerDied","Data":"c6e59997d39f55c143817979bf77324e0bfa3ce7acaba0c232c0d7e195571114"}
Jul 10 18:58:50.291125 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:50.291100    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:51.118261 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.118231    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:51.118428 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:51.118353    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:51.281196 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.281173    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 18:58:51.281549 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.281523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh" event={"ID":"ce8d7b43-bcf9-495a-9b4b-503fb697e8e5","Type":"ContainerStarted","Data":"c5d6d40ff5cf92511a716f15f44b63c65fdacb7735c70c65919f12dac2678f11"}
Jul 10 18:58:51.281724 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.281706    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:51.281781 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.281770    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:51.297896 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.297870    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:58:51.314320 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.314129    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh" podStartSLOduration=11.62452321 podStartE2EDuration="30.31411149s" totalImagesPullingTime="18.68958828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:51.312274941 +0000 UTC m=+30.768825354" watchObservedRunningTime="2026-07-10 18:58:51.31411149 +0000 UTC m=+30.770661868"
Jul 10 18:58:51.601552 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.601522    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w6cw9"]
Jul 10 18:58:51.601700 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.601658    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:51.601800 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:51.601774    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:51.603977 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.603945    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xxrhq"]
Jul 10 18:58:51.604088 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.604054    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:51.604163 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:51.604146    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:51.604696 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.604673    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sl68j"]
Jul 10 18:58:51.604795 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:51.604756    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:51.604856 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:51.604833    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:52.286208 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:52.286179    2579 generic.go:356] "Generic (PLEG): container finished" podID="4095efea-3030-4f10-878d-02894f3fa560" containerID="e1cf3e7c27471b46b8a65678b912d8d24a91020af0d677e7a8a7695644993a3c" exitCode=0
Jul 10 18:58:52.286688 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:52.286283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8xnz" event={"ID":"4095efea-3030-4f10-878d-02894f3fa560","Type":"ContainerDied","Data":"e1cf3e7c27471b46b8a65678b912d8d24a91020af0d677e7a8a7695644993a3c"}
Jul 10 18:58:52.861965 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:52.861896    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:52.936676 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:52.936630    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:53.117610 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:53.117530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:53.117766 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:53.117540    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:53.117766 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:53.117655    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:53.117766 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:53.117546    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:53.117766 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:53.117728    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:53.117952 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:53.117802    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:54.657846 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:54.657796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:54.658390 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:54.657902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:54.658390 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:54.657971    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:54.658390 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:54.658003    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:54.658390 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:54.658051    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret podName:b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:26.658035414 +0000 UTC m=+66.114585783 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret") pod "global-pull-secret-syncer-xxrhq" (UID: "b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85") : object "kube-system"/"original-pull-secret" not registered
Jul 10 18:58:54.658390 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:54.658072    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs podName:03c8f640-6992-4fac-8c1d-802baf0a69d4 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:26.658061413 +0000 UTC m=+66.114611773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs") pod "network-metrics-daemon-w6cw9" (UID: "03c8f640-6992-4fac-8c1d-802baf0a69d4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 18:58:54.860388 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:54.860347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkjf\" (UniqueName: \"kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf\") pod \"network-check-target-sl68j\" (UID: \"c230e79e-35d4-49e0-b95c-1c994f296ba5\") " pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:54.860639 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:54.860499    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 18:58:54.860639 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:54.860521    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 18:58:54.860639 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:54.860531    2579 projected.go:196] Error preparing data for projected volume kube-api-access-2jkjf for pod openshift-network-diagnostics/network-check-target-sl68j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:54.860639 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:54.860588    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf podName:c230e79e-35d4-49e0-b95c-1c994f296ba5 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:26.86057215 +0000 UTC m=+66.317122506 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2jkjf" (UniqueName: "kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf") pod "network-check-target-sl68j" (UID: "c230e79e-35d4-49e0-b95c-1c994f296ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 18:58:55.117021 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.116994    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:55.117021 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.117016    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:55.117218 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:55.117169    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sl68j" podUID="c230e79e-35d4-49e0-b95c-1c994f296ba5"
Jul 10 18:58:55.117218 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.117204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:55.117331 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:55.117303    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxrhq" podUID="b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85"
Jul 10 18:58:55.117484 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:55.117452    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w6cw9" podUID="03c8f640-6992-4fac-8c1d-802baf0a69d4"
Jul 10 18:58:55.318679 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.318603    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeReady"
Jul 10 18:58:55.318822 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.318746    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 18:58:55.371008 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.370976    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m7bqv"]
Jul 10 18:58:55.375389 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.375354    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.375389 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.375386    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9nb85"]
Jul 10 18:58:55.378350 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.378332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9nb85"
Jul 10 18:58:55.378462 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.378384    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 18:58:55.378766 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.378726    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 18:58:55.378998 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.378978    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-99kdr\""
Jul 10 18:58:55.381407 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.381391    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 18:58:55.381609 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.381592    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 18:58:55.381956 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.381920    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 18:58:55.382126 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.382108    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2w9vx\""
Jul 10 18:58:55.388108 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.388067    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7bqv"]
Jul 10 18:58:55.396630 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.396610    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9nb85"]
Jul 10 18:58:55.564224 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.564190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e979646e-840e-4a43-8aff-705dbdc1f116-config-volume\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.564224 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.564228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cks7c\" (UniqueName: \"kubernetes.io/projected/10f54178-163e-47c9-8a23-586879ffa3ba-kube-api-access-cks7c\") pod \"ingress-canary-9nb85\" (UID: \"10f54178-163e-47c9-8a23-586879ffa3ba\") " pod="openshift-ingress-canary/ingress-canary-9nb85"
Jul 10 18:58:55.564458 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.564313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.564458 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.564397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e979646e-840e-4a43-8aff-705dbdc1f116-tmp-dir\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.564549 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.564455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq2ld\" (UniqueName: \"kubernetes.io/projected/e979646e-840e-4a43-8aff-705dbdc1f116-kube-api-access-vq2ld\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.564549 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.564475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10f54178-163e-47c9-8a23-586879ffa3ba-cert\") pod \"ingress-canary-9nb85\" (UID: \"10f54178-163e-47c9-8a23-586879ffa3ba\") " pod="openshift-ingress-canary/ingress-canary-9nb85"
Jul 10 18:58:55.633411 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.633362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:55.665048 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.665016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e979646e-840e-4a43-8aff-705dbdc1f116-config-volume\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.665048 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.665050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cks7c\" (UniqueName: \"kubernetes.io/projected/10f54178-163e-47c9-8a23-586879ffa3ba-kube-api-access-cks7c\") pod \"ingress-canary-9nb85\" (UID: \"10f54178-163e-47c9-8a23-586879ffa3ba\") " pod="openshift-ingress-canary/ingress-canary-9nb85"
Jul 10 18:58:55.665752 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.665421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.665752 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.665442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e979646e-840e-4a43-8aff-705dbdc1f116-tmp-dir\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.665752 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.665471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2ld\" (UniqueName: \"kubernetes.io/projected/e979646e-840e-4a43-8aff-705dbdc1f116-kube-api-access-vq2ld\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.665752 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.665488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10f54178-163e-47c9-8a23-586879ffa3ba-cert\") pod \"ingress-canary-9nb85\" (UID: \"10f54178-163e-47c9-8a23-586879ffa3ba\") " pod="openshift-ingress-canary/ingress-canary-9nb85"
Jul 10 18:58:55.665752 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.665704    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e979646e-840e-4a43-8aff-705dbdc1f116-config-volume\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.666001 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:55.665809    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:58:55.666001 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.665841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e979646e-840e-4a43-8aff-705dbdc1f116-tmp-dir\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.666001 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:55.665873    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls podName:e979646e-840e-4a43-8aff-705dbdc1f116 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:56.165855273 +0000 UTC m=+35.622405643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls") pod "dns-default-m7bqv" (UID: "e979646e-840e-4a43-8aff-705dbdc1f116") : secret "dns-default-metrics-tls" not found
Jul 10 18:58:55.670863 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.670837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10f54178-163e-47c9-8a23-586879ffa3ba-cert\") pod \"ingress-canary-9nb85\" (UID: \"10f54178-163e-47c9-8a23-586879ffa3ba\") " pod="openshift-ingress-canary/ingress-canary-9nb85"
Jul 10 18:58:55.675765 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.675717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq2ld\" (UniqueName: \"kubernetes.io/projected/e979646e-840e-4a43-8aff-705dbdc1f116-kube-api-access-vq2ld\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:55.676055 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.676034    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cks7c\" (UniqueName: \"kubernetes.io/projected/10f54178-163e-47c9-8a23-586879ffa3ba-kube-api-access-cks7c\") pod \"ingress-canary-9nb85\" (UID: \"10f54178-163e-47c9-8a23-586879ffa3ba\") " pod="openshift-ingress-canary/ingress-canary-9nb85"
Jul 10 18:58:55.693821 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.693797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9nb85"
Jul 10 18:58:55.732133 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:55.732092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:56.146407 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:56.146217    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9nb85"]
Jul 10 18:58:56.150082 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:58:56.150055    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f54178_163e_47c9_8a23_586879ffa3ba.slice/crio-68daf631164f83c9a928ba2fc8a8ecfc6d0cd9d88cbfff2f3871b6c82894efa7 WatchSource:0}: Error finding container 68daf631164f83c9a928ba2fc8a8ecfc6d0cd9d88cbfff2f3871b6c82894efa7: Status 404 returned error can't find the container with id 68daf631164f83c9a928ba2fc8a8ecfc6d0cd9d88cbfff2f3871b6c82894efa7
Jul 10 18:58:56.172315 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:56.172292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:56.172438 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:56.172425    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:58:56.172480 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:56.172470    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls podName:e979646e-840e-4a43-8aff-705dbdc1f116 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:57.172457841 +0000 UTC m=+36.629008197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls") pod "dns-default-m7bqv" (UID: "e979646e-840e-4a43-8aff-705dbdc1f116") : secret "dns-default-metrics-tls" not found
Jul 10 18:58:56.296799 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:56.296771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9nb85" event={"ID":"10f54178-163e-47c9-8a23-586879ffa3ba","Type":"ContainerStarted","Data":"68daf631164f83c9a928ba2fc8a8ecfc6d0cd9d88cbfff2f3871b6c82894efa7"}
Jul 10 18:58:56.299305 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:56.299281    2579 generic.go:356] "Generic (PLEG): container finished" podID="4095efea-3030-4f10-878d-02894f3fa560" containerID="7cda8417987f3f5cd3d0d85e319a08378c2655a4d91339145e102c3fe98dfe5e" exitCode=0
Jul 10 18:58:56.299414 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:56.299313    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8xnz" event={"ID":"4095efea-3030-4f10-878d-02894f3fa560","Type":"ContainerDied","Data":"7cda8417987f3f5cd3d0d85e319a08378c2655a4d91339145e102c3fe98dfe5e"}
Jul 10 18:58:56.665281 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:56.665229    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:56.767859 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:56.767827    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:56.866604 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:56.866568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:57.117822 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.117745    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:58:57.117989 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.117746    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:58:57.117989 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.117886    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:58:57.125547 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.125523    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:58:57.125851 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.125834    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:58:57.126815 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.126785    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xvd26\""
Jul 10 18:58:57.126815 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.126807    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:58:57.126996 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.126830    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:58:57.126996 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.126792    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k2x45\""
Jul 10 18:58:57.180075 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.180044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:57.180206 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:57.180190    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:58:57.180271 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:57.180257    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls podName:e979646e-840e-4a43-8aff-705dbdc1f116 nodeName:}" failed. No retries permitted until 2026-07-10 18:58:59.180236594 +0000 UTC m=+38.636786956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls") pod "dns-default-m7bqv" (UID: "e979646e-840e-4a43-8aff-705dbdc1f116") : secret "dns-default-metrics-tls" not found
Jul 10 18:58:57.305841 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.305805    2579 generic.go:356] "Generic (PLEG): container finished" podID="4095efea-3030-4f10-878d-02894f3fa560" containerID="fa5a86d5d66c883da0f270c2e95f15e6c5012587844b8eb5bcefe43c042b1b5e" exitCode=0
Jul 10 18:58:57.306011 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:57.305864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8xnz" event={"ID":"4095efea-3030-4f10-878d-02894f3fa560","Type":"ContainerDied","Data":"fa5a86d5d66c883da0f270c2e95f15e6c5012587844b8eb5bcefe43c042b1b5e"}
Jul 10 18:58:58.311922 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:58.311713    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8xnz" event={"ID":"4095efea-3030-4f10-878d-02894f3fa560","Type":"ContainerStarted","Data":"434e2aae07b628bb60cd74f05af863b3e7794b478ddb12d54cfce1db0044b565"}
Jul 10 18:58:58.339166 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:58.339113    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b8xnz" podStartSLOduration=8.93795489 podStartE2EDuration="37.339099195s" totalImagesPullingTime="28.401144305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:58.337732373 +0000 UTC m=+37.794282751" watchObservedRunningTime="2026-07-10 18:58:58.339099195 +0000 UTC m=+37.795649573"
Jul 10 18:58:58.468550 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:58.468520    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:58.576330 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:58.576239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:58.710461 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:58.710427    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:58.824651 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:58.824616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:58:59.197664 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:59.197637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:58:59.197813 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:59.197767    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:58:59.197870 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:58:59.197816    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls podName:e979646e-840e-4a43-8aff-705dbdc1f116 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:03.197802146 +0000 UTC m=+42.654352502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls") pod "dns-default-m7bqv" (UID: "e979646e-840e-4a43-8aff-705dbdc1f116") : secret "dns-default-metrics-tls" not found
Jul 10 18:58:59.314966 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:59.314935    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9nb85" event={"ID":"10f54178-163e-47c9-8a23-586879ffa3ba","Type":"ContainerStarted","Data":"16fc70a421b5ad762c86e4550fc25399c5f19b6c4829bde54be756ad7e4a0937"}
Jul 10 18:58:59.333549 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:59.333503    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9nb85" podStartSLOduration=2.056784046 podStartE2EDuration="4.33348689s" totalImagesPullingTime="2.276702844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:58:59.333181795 +0000 UTC m=+38.789732173" watchObservedRunningTime="2026-07-10 18:58:59.33348689 +0000 UTC m=+38.790037308"
Jul 10 18:58:59.655186 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:58:59.655156    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:01.099518 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:01.099475    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:01.163220 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:01.163191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:03.229700 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:03.229647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:59:03.230087 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:03.229795    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:59:03.230087 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:03.229863    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls podName:e979646e-840e-4a43-8aff-705dbdc1f116 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:11.229847308 +0000 UTC m=+50.686397667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls") pod "dns-default-m7bqv" (UID: "e979646e-840e-4a43-8aff-705dbdc1f116") : secret "dns-default-metrics-tls" not found
Jul 10 18:59:04.133412 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.133366    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-87c77"]
Jul 10 18:59:04.176104 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.176069    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-87c77"]
Jul 10 18:59:04.176251 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.176175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.178996 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.178949    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 10 18:59:04.178996 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.178986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 10 18:59:04.179156 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.179009    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-s9dbq\""
Jul 10 18:59:04.179995 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.179974    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 18:59:04.180087 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.180014    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 18:59:04.185066 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.185049    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 10 18:59:04.237404 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.237365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58cdd02c-fa04-4d34-9e93-ef6619456821-serving-cert\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.237773 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.237431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58cdd02c-fa04-4d34-9e93-ef6619456821-tmp\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.237773 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.237471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btf4b\" (UniqueName: \"kubernetes.io/projected/58cdd02c-fa04-4d34-9e93-ef6619456821-kube-api-access-btf4b\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.237773 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.237515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cdd02c-fa04-4d34-9e93-ef6619456821-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.237773 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.237543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cdd02c-fa04-4d34-9e93-ef6619456821-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.237773 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.237566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/58cdd02c-fa04-4d34-9e93-ef6619456821-snapshots\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.238695 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.238674    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-44g66"]
Jul 10 18:59:04.263620 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.263600    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"]
Jul 10 18:59:04.263768 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.263741    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-44g66"
Jul 10 18:59:04.266486 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.266464    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8hd7h\""
Jul 10 18:59:04.266743 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.266724    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 10 18:59:04.266826 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.266747    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:59:04.286386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.286350    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-67btj"]
Jul 10 18:59:04.286547 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.286529    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:04.289131 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.289107    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mhsg4\""
Jul 10 18:59:04.289336 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.289321    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 10 18:59:04.289436 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.289350    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 10 18:59:04.289631 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.289616    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:59:04.305882 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.305860    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-44g66"]
Jul 10 18:59:04.305968 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.305893    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"]
Jul 10 18:59:04.305968 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.305911    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-67btj"]
Jul 10 18:59:04.306046 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.305975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.308558 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.308540    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 10 18:59:04.308652 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.308575    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 10 18:59:04.308652 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.308577    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 10 18:59:04.308845 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.308819    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 10 18:59:04.308943 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.308866    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-h6fr4\""
Jul 10 18:59:04.313865 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.313848    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 10 18:59:04.338023 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.337998    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b8f9f9c6d-5bl7h"]
Jul 10 18:59:04.338198 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58cdd02c-fa04-4d34-9e93-ef6619456821-tmp\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.338260 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btf4b\" (UniqueName: \"kubernetes.io/projected/58cdd02c-fa04-4d34-9e93-ef6619456821-kube-api-access-btf4b\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.338260 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cdd02c-fa04-4d34-9e93-ef6619456821-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.338363 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cdd02c-fa04-4d34-9e93-ef6619456821-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.338439 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/58cdd02c-fa04-4d34-9e93-ef6619456821-snapshots\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.338491 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2bk5\" (UniqueName: \"kubernetes.io/projected/485642a5-8099-4fd0-810e-4dd570b455e6-kube-api-access-t2bk5\") pod \"volume-data-source-validator-78495597f6-44g66\" (UID: \"485642a5-8099-4fd0-810e-4dd570b455e6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-44g66"
Jul 10 18:59:04.338535 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9jwt\" (UniqueName: \"kubernetes.io/projected/15852620-efcb-48e1-bf17-6073adc16659-kube-api-access-f9jwt\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.338599 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338581    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftsk5\" (UniqueName: \"kubernetes.io/projected/a29a489e-0911-4526-8d05-fdd45e66b7ba-kube-api-access-ftsk5\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:04.338649 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338612    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58cdd02c-fa04-4d34-9e93-ef6619456821-tmp\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.338649 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15852620-efcb-48e1-bf17-6073adc16659-config\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.338649 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15852620-efcb-48e1-bf17-6073adc16659-serving-cert\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.338787 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15852620-efcb-48e1-bf17-6073adc16659-trusted-ca\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.338836 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58cdd02c-fa04-4d34-9e93-ef6619456821-serving-cert\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.338836 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:04.338926 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338862    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cdd02c-fa04-4d34-9e93-ef6619456821-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.338961 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.338935    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/58cdd02c-fa04-4d34-9e93-ef6619456821-snapshots\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.339180 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.339162    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58cdd02c-fa04-4d34-9e93-ef6619456821-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.342518 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.342493    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58cdd02c-fa04-4d34-9e93-ef6619456821-serving-cert\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.354554 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.354535    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btf4b\" (UniqueName: \"kubernetes.io/projected/58cdd02c-fa04-4d34-9e93-ef6619456821-kube-api-access-btf4b\") pod \"insights-operator-68d9dd94cf-87c77\" (UID: \"58cdd02c-fa04-4d34-9e93-ef6619456821\") " pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.362037 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.362020    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.366032 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.366008    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 10 18:59:04.366191 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.366018    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 18:59:04.366456 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.366186    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 10 18:59:04.366647 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.366227    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 10 18:59:04.366727 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.366257    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-698r5\""
Jul 10 18:59:04.366727 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.366272    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 18:59:04.382696 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.382677    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 10 18:59:04.383331 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.383316    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b8f9f9c6d-5bl7h"]
Jul 10 18:59:04.439186 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2bk5\" (UniqueName: \"kubernetes.io/projected/485642a5-8099-4fd0-810e-4dd570b455e6-kube-api-access-t2bk5\") pod \"volume-data-source-validator-78495597f6-44g66\" (UID: \"485642a5-8099-4fd0-810e-4dd570b455e6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-44g66"
Jul 10 18:59:04.439186 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9jwt\" (UniqueName: \"kubernetes.io/projected/15852620-efcb-48e1-bf17-6073adc16659-kube-api-access-f9jwt\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.439186 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-stats-auth\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.439186 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftsk5\" (UniqueName: \"kubernetes.io/projected/a29a489e-0911-4526-8d05-fdd45e66b7ba-kube-api-access-ftsk5\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:04.439404 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15852620-efcb-48e1-bf17-6073adc16659-config\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.439448 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15852620-efcb-48e1-bf17-6073adc16659-serving-cert\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.439477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15852620-efcb-48e1-bf17-6073adc16659-trusted-ca\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.439551 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:04.439592 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439569    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-default-certificate\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.439636 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439592    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.439636 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.439731 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:04.439668    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 18:59:04.439781 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.439723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvp6m\" (UniqueName: \"kubernetes.io/projected/fe60350d-1703-4cd7-b18a-deca0ffe4d54-kube-api-access-rvp6m\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.439781 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:04.439731    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls podName:a29a489e-0911-4526-8d05-fdd45e66b7ba nodeName:}" failed. No retries permitted until 2026-07-10 18:59:04.939709397 +0000 UTC m=+44.396259753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls") pod "cluster-samples-operator-65db858894-62nlw" (UID: "a29a489e-0911-4526-8d05-fdd45e66b7ba") : secret "samples-operator-tls" not found
Jul 10 18:59:04.440098 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.440076    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15852620-efcb-48e1-bf17-6073adc16659-config\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.440637 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.440621    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15852620-efcb-48e1-bf17-6073adc16659-trusted-ca\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.441646 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.441625    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15852620-efcb-48e1-bf17-6073adc16659-serving-cert\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.448239 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.448200    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9jwt\" (UniqueName: \"kubernetes.io/projected/15852620-efcb-48e1-bf17-6073adc16659-kube-api-access-f9jwt\") pod \"console-operator-7866497494-67btj\" (UID: \"15852620-efcb-48e1-bf17-6073adc16659\") " pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.448347 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.448324    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftsk5\" (UniqueName: \"kubernetes.io/projected/a29a489e-0911-4526-8d05-fdd45e66b7ba-kube-api-access-ftsk5\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:04.448543 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.448524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2bk5\" (UniqueName: \"kubernetes.io/projected/485642a5-8099-4fd0-810e-4dd570b455e6-kube-api-access-t2bk5\") pod \"volume-data-source-validator-78495597f6-44g66\" (UID: \"485642a5-8099-4fd0-810e-4dd570b455e6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-44g66"
Jul 10 18:59:04.485299 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.485277    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-87c77"
Jul 10 18:59:04.522393 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.522333    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:04.540587 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.540565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-default-certificate\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.540667 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.540593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.540667 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.540611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.540667 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.540646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvp6m\" (UniqueName: \"kubernetes.io/projected/fe60350d-1703-4cd7-b18a-deca0ffe4d54-kube-api-access-rvp6m\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.540826 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:04.540757    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 18:59:04.540826 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:04.540763    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:05.040745428 +0000 UTC m=+44.497295803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : configmap references non-existent config key: service-ca.crt
Jul 10 18:59:04.540919 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.540827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-stats-auth\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.540919 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:04.540886    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:05.040856657 +0000 UTC m=+44.497407022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : secret "router-metrics-certs-default" not found
Jul 10 18:59:04.542933 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.542915    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-stats-auth\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.543143 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.543127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-default-certificate\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.549317 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.549298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvp6m\" (UniqueName: \"kubernetes.io/projected/fe60350d-1703-4cd7-b18a-deca0ffe4d54-kube-api-access-rvp6m\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:04.572457 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.572336    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-44g66"
Jul 10 18:59:04.613644 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.613615    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:04.644195 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.644172    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:04.660827 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.660799    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-87c77"]
Jul 10 18:59:04.727538 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.727500    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-44g66"]
Jul 10 18:59:04.731021 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:04.730935    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485642a5_8099_4fd0_810e_4dd570b455e6.slice/crio-c8ec5a9cfe911a644bda4a4da4a0310b49a06cfd6ad4476b7698a3d83a67d061 WatchSource:0}: Error finding container c8ec5a9cfe911a644bda4a4da4a0310b49a06cfd6ad4476b7698a3d83a67d061: Status 404 returned error can't find the container with id c8ec5a9cfe911a644bda4a4da4a0310b49a06cfd6ad4476b7698a3d83a67d061
Jul 10 18:59:04.765621 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.765550    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-67btj"]
Jul 10 18:59:04.767901 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:04.767875    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15852620_efcb_48e1_bf17_6073adc16659.slice/crio-d7aff379dbbd4794c08cbbaaf9a8214defb1e4e56c671c2e0362f87bb180e3b5 WatchSource:0}: Error finding container d7aff379dbbd4794c08cbbaaf9a8214defb1e4e56c671c2e0362f87bb180e3b5: Status 404 returned error can't find the container with id d7aff379dbbd4794c08cbbaaf9a8214defb1e4e56c671c2e0362f87bb180e3b5
Jul 10 18:59:04.945931 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:04.945847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:04.946081 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:04.945999    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 18:59:04.946139 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:04.946088    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls podName:a29a489e-0911-4526-8d05-fdd45e66b7ba nodeName:}" failed. No retries permitted until 2026-07-10 18:59:05.946056224 +0000 UTC m=+45.402606582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls") pod "cluster-samples-operator-65db858894-62nlw" (UID: "a29a489e-0911-4526-8d05-fdd45e66b7ba") : secret "samples-operator-tls" not found
Jul 10 18:59:05.046623 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:05.046589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:05.046787 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:05.046630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:05.046787 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:05.046723    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:06.04670518 +0000 UTC m=+45.503255541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : configmap references non-existent config key: service-ca.crt
Jul 10 18:59:05.046787 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:05.046731    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 18:59:05.046787 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:05.046762    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:06.046755769 +0000 UTC m=+45.503306125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : secret "router-metrics-certs-default" not found
Jul 10 18:59:05.330020 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:05.329933    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-44g66" event={"ID":"485642a5-8099-4fd0-810e-4dd570b455e6","Type":"ContainerStarted","Data":"c8ec5a9cfe911a644bda4a4da4a0310b49a06cfd6ad4476b7698a3d83a67d061"}
Jul 10 18:59:05.331548 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:05.331519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-87c77" event={"ID":"58cdd02c-fa04-4d34-9e93-ef6619456821","Type":"ContainerStarted","Data":"30d609dbd7d5ceb43cd44f6c4db32e2440bc31980a9a7c1013e2cfc2b00070ed"}
Jul 10 18:59:05.333040 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:05.333000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-67btj" event={"ID":"15852620-efcb-48e1-bf17-6073adc16659","Type":"ContainerStarted","Data":"d7aff379dbbd4794c08cbbaaf9a8214defb1e4e56c671c2e0362f87bb180e3b5"}
Jul 10 18:59:05.953380 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:05.953099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:05.953380 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:05.953324    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 18:59:05.953582 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:05.953414    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls podName:a29a489e-0911-4526-8d05-fdd45e66b7ba nodeName:}" failed. No retries permitted until 2026-07-10 18:59:07.953391195 +0000 UTC m=+47.409941574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls") pod "cluster-samples-operator-65db858894-62nlw" (UID: "a29a489e-0911-4526-8d05-fdd45e66b7ba") : secret "samples-operator-tls" not found
Jul 10 18:59:06.054947 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:06.054342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:06.054947 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:06.054413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:06.054947 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:06.054592    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:08.05456685 +0000 UTC m=+47.511117225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : configmap references non-existent config key: service-ca.crt
Jul 10 18:59:06.054947 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:06.054595    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 18:59:06.054947 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:06.054709    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:08.054699728 +0000 UTC m=+47.511250085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : secret "router-metrics-certs-default" not found
Jul 10 18:59:07.972260 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:07.972228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:07.972636 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:07.972364    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 18:59:07.972636 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:07.972436    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls podName:a29a489e-0911-4526-8d05-fdd45e66b7ba nodeName:}" failed. No retries permitted until 2026-07-10 18:59:11.972420934 +0000 UTC m=+51.428971291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls") pod "cluster-samples-operator-65db858894-62nlw" (UID: "a29a489e-0911-4526-8d05-fdd45e66b7ba") : secret "samples-operator-tls" not found
Jul 10 18:59:08.072936 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.072882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:08.072936 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.072932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:08.073160 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:08.073138    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 18:59:08.073262 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:08.073144    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:12.073121758 +0000 UTC m=+51.529672115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : configmap references non-existent config key: service-ca.crt
Jul 10 18:59:08.073262 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:08.073208    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:12.073192317 +0000 UTC m=+51.529742677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : secret "router-metrics-certs-default" not found
Jul 10 18:59:08.342465 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.342365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-44g66" event={"ID":"485642a5-8099-4fd0-810e-4dd570b455e6","Type":"ContainerStarted","Data":"d629c21c2ca1286411b51f3108c252674cb4cab4c86c239e04fd4b75311d6ca9"}
Jul 10 18:59:08.343823 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.343797    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-87c77" event={"ID":"58cdd02c-fa04-4d34-9e93-ef6619456821","Type":"ContainerStarted","Data":"4faaeb7a05aefb4b45b9d8a68192762a60bb6c7b8a7fa6b53df284dd455dad31"}
Jul 10 18:59:08.345321 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.345298    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/0.log"
Jul 10 18:59:08.345422 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.345336    2579 generic.go:356] "Generic (PLEG): container finished" podID="15852620-efcb-48e1-bf17-6073adc16659" containerID="556bf6719a78616b5ffb9a905b248479ad2337de4d336dfb7db764a50af7370b" exitCode=255
Jul 10 18:59:08.345422 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.345365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-67btj" event={"ID":"15852620-efcb-48e1-bf17-6073adc16659","Type":"ContainerDied","Data":"556bf6719a78616b5ffb9a905b248479ad2337de4d336dfb7db764a50af7370b"}
Jul 10 18:59:08.345627 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.345611    2579 scope.go:117] "RemoveContainer" containerID="556bf6719a78616b5ffb9a905b248479ad2337de4d336dfb7db764a50af7370b"
Jul 10 18:59:08.382121 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.381993    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-44g66" podStartSLOduration=1.170497625 podStartE2EDuration="4.381973069s" totalImagesPullingTime="3.211475444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:08.36299049 +0000 UTC m=+47.819540868" watchObservedRunningTime="2026-07-10 18:59:08.381973069 +0000 UTC m=+47.838523447"
Jul 10 18:59:08.400229 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.400176    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-87c77" podStartSLOduration=1.120890112 podStartE2EDuration="4.400159612s" totalImagesPullingTime="3.2792695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:08.400137008 +0000 UTC m=+47.856687414" watchObservedRunningTime="2026-07-10 18:59:08.400159612 +0000 UTC m=+47.856709987"
Jul 10 18:59:08.459826 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.459790    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:08.479284 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.479244    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-547b66d8cd-mgcng"]
Jul 10 18:59:08.495736 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.495706    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-547b66d8cd-mgcng"]
Jul 10 18:59:08.495912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.495810    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.498951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.498920    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ndwz8\""
Jul 10 18:59:08.499358 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.499178    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 18:59:08.499358 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.499244    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 18:59:08.499358 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.499255    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 18:59:08.505574 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.505549    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 18:59:08.537024 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.536984    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:08.577545 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.577506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-image-registry-private-configuration\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.577545 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.577546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.577719 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.577568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-bound-sa-token\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.577719 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.577589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/452f8c4a-8154-403d-a457-96cc8d4cf1d6-ca-trust-extracted\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.577719 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.577640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c627\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-kube-api-access-9c627\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.577864 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.577790    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-trusted-ca\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.577864 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.577824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-certificates\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.577925 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.577882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-installation-pull-secrets\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.678469 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.678429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/452f8c4a-8154-403d-a457-96cc8d4cf1d6-ca-trust-extracted\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.678469 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.678472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c627\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-kube-api-access-9c627\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.678690 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.678541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-trusted-ca\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.678690 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.678558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-certificates\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.678690 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.678592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-installation-pull-secrets\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.678690 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.678645    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-image-registry-private-configuration\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.678690 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.678669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.678917 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.678691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-bound-sa-token\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.678973 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.678917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/452f8c4a-8154-403d-a457-96cc8d4cf1d6-ca-trust-extracted\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.678973 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:08.678929    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:59:08.678973 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:08.678946    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b66d8cd-mgcng: secret "image-registry-tls" not found
Jul 10 18:59:08.679107 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:08.679002    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls podName:452f8c4a-8154-403d-a457-96cc8d4cf1d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:09.178982689 +0000 UTC m=+48.635533059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls") pod "image-registry-547b66d8cd-mgcng" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6") : secret "image-registry-tls" not found
Jul 10 18:59:08.679223 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.679203    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-certificates\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.679554 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.679529    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-trusted-ca\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.681228 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.681206    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-installation-pull-secrets\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.681228 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.681219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-image-registry-private-configuration\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.690314 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.690291    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-bound-sa-token\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:08.690400 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:08.690354    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c627\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-kube-api-access-9c627\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:09.129751 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.129716    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:09.182256 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.182220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:09.182455 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:09.182363    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:59:09.182455 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:09.182397    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b66d8cd-mgcng: secret "image-registry-tls" not found
Jul 10 18:59:09.182455 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:09.182451    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls podName:452f8c4a-8154-403d-a457-96cc8d4cf1d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:10.182437131 +0000 UTC m=+49.638987519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls") pod "image-registry-547b66d8cd-mgcng" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6") : secret "image-registry-tls" not found
Jul 10 18:59:09.224613 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.224580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:09.326918 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.326817    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:09.350208 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.350178    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 18:59:09.350678 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.350663    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/0.log"
Jul 10 18:59:09.350771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.350699    2579 generic.go:356] "Generic (PLEG): container finished" podID="15852620-efcb-48e1-bf17-6073adc16659" containerID="3c779124b2fdf28b46d1bb9871159045d696e4efc5e5a370d3bc68d1a7486f9c" exitCode=255
Jul 10 18:59:09.350821 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.350795    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-67btj" event={"ID":"15852620-efcb-48e1-bf17-6073adc16659","Type":"ContainerDied","Data":"3c779124b2fdf28b46d1bb9871159045d696e4efc5e5a370d3bc68d1a7486f9c"}
Jul 10 18:59:09.350872 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.350857    2579 scope.go:117] "RemoveContainer" containerID="556bf6719a78616b5ffb9a905b248479ad2337de4d336dfb7db764a50af7370b"
Jul 10 18:59:09.351101 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.351081    2579 scope.go:117] "RemoveContainer" containerID="3c779124b2fdf28b46d1bb9871159045d696e4efc5e5a370d3bc68d1a7486f9c"
Jul 10 18:59:09.351277 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:09.351258    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-67btj_openshift-console-operator(15852620-efcb-48e1-bf17-6073adc16659)\"" pod="openshift-console-operator/console-operator-7866497494-67btj" podUID="15852620-efcb-48e1-bf17-6073adc16659"
Jul 10 18:59:09.627590 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.627565    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5bfbm"]
Jul 10 18:59:09.654047 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.654022    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5bfbm"]
Jul 10 18:59:09.654165 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.654144    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.656934 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.656913    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2qznj\""
Jul 10 18:59:09.657066 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.657028    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 18:59:09.657066 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.657028    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 18:59:09.686149 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.686126    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:09.687088 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.687071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.687133 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.687125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lgnm\" (UniqueName: \"kubernetes.io/projected/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-api-access-7lgnm\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.687163 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.687145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa064662-d006-4909-b0d9-39f99b2bbd38-crio-socket\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.687256 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.687242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.687291 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.687269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa064662-d006-4909-b0d9-39f99b2bbd38-data-volume\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.773364 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.773339    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:09.788612 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.788585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.788721 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.788620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa064662-d006-4909-b0d9-39f99b2bbd38-data-volume\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.788721 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:09.788688    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:59:09.788721 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.788692    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.788869 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:09.788738    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm podName:fa064662-d006-4909-b0d9-39f99b2bbd38 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:10.288723387 +0000 UTC m=+49.745273747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5bfbm" (UID: "fa064662-d006-4909-b0d9-39f99b2bbd38") : configmap "kube-rbac-proxy" not found
Jul 10 18:59:09.788869 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.788770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lgnm\" (UniqueName: \"kubernetes.io/projected/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-api-access-7lgnm\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.788869 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.788790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa064662-d006-4909-b0d9-39f99b2bbd38-crio-socket\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.788869 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:09.788801    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:09.788869 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:09.788851    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls podName:fa064662-d006-4909-b0d9-39f99b2bbd38 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:10.288835989 +0000 UTC m=+49.745386370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5bfbm" (UID: "fa064662-d006-4909-b0d9-39f99b2bbd38") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:09.789023 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.788942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa064662-d006-4909-b0d9-39f99b2bbd38-data-volume\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.789023 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.788992    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa064662-d006-4909-b0d9-39f99b2bbd38-crio-socket\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:09.799778 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:09.799754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lgnm\" (UniqueName: \"kubernetes.io/projected/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-api-access-7lgnm\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:10.191881 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:10.191846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:10.192216 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:10.191996    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:59:10.192216 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:10.192014    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b66d8cd-mgcng: secret "image-registry-tls" not found
Jul 10 18:59:10.192216 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:10.192067    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls podName:452f8c4a-8154-403d-a457-96cc8d4cf1d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:12.19205283 +0000 UTC m=+51.648603227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls") pod "image-registry-547b66d8cd-mgcng" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6") : secret "image-registry-tls" not found
Jul 10 18:59:10.292554 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:10.292526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:10.292694 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:10.292667    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:10.292730 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:10.292692    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:10.292730 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:10.292725    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls podName:fa064662-d006-4909-b0d9-39f99b2bbd38 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:11.292708422 +0000 UTC m=+50.749258779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5bfbm" (UID: "fa064662-d006-4909-b0d9-39f99b2bbd38") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:10.292794 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:10.292764    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:59:10.292831 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:10.292808    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm podName:fa064662-d006-4909-b0d9-39f99b2bbd38 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:11.29279804 +0000 UTC m=+50.749348397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5bfbm" (UID: "fa064662-d006-4909-b0d9-39f99b2bbd38") : configmap "kube-rbac-proxy" not found
Jul 10 18:59:10.334358 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:10.334330    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:10.354804 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:10.354781    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 18:59:10.355074 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:10.355061    2579 scope.go:117] "RemoveContainer" containerID="3c779124b2fdf28b46d1bb9871159045d696e4efc5e5a370d3bc68d1a7486f9c"
Jul 10 18:59:10.355215 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:10.355199    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-67btj_openshift-console-operator(15852620-efcb-48e1-bf17-6073adc16659)\"" pod="openshift-console-operator/console-operator-7866497494-67btj" podUID="15852620-efcb-48e1-bf17-6073adc16659"
Jul 10 18:59:10.433568 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:10.433539    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:11.298697 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:11.298664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:11.299137 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:11.298731    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:59:11.299137 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:11.298767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:11.299137 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:11.298789    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:59:11.299137 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:11.298853    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm podName:fa064662-d006-4909-b0d9-39f99b2bbd38 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:13.298835487 +0000 UTC m=+52.755385855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5bfbm" (UID: "fa064662-d006-4909-b0d9-39f99b2bbd38") : configmap "kube-rbac-proxy" not found
Jul 10 18:59:11.299137 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:11.298878    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:11.299137 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:11.298879    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 18:59:11.299137 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:11.298912    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls podName:fa064662-d006-4909-b0d9-39f99b2bbd38 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:13.298902385 +0000 UTC m=+52.755452755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5bfbm" (UID: "fa064662-d006-4909-b0d9-39f99b2bbd38") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:11.299137 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:11.298940    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls podName:e979646e-840e-4a43-8aff-705dbdc1f116 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:27.298926743 +0000 UTC m=+66.755477100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls") pod "dns-default-m7bqv" (UID: "e979646e-840e-4a43-8aff-705dbdc1f116") : secret "dns-default-metrics-tls" not found
Jul 10 18:59:12.004927 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:12.004893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:12.005094 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:12.005000    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 18:59:12.005094 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:12.005052    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls podName:a29a489e-0911-4526-8d05-fdd45e66b7ba nodeName:}" failed. No retries permitted until 2026-07-10 18:59:20.005038574 +0000 UTC m=+59.461588931 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls") pod "cluster-samples-operator-65db858894-62nlw" (UID: "a29a489e-0911-4526-8d05-fdd45e66b7ba") : secret "samples-operator-tls" not found
Jul 10 18:59:12.106072 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:12.106038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:12.106245 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:12.106152    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:12.106245 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:12.106201    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 18:59:12.106356 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:12.106283    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:20.106263487 +0000 UTC m=+59.562813863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : secret "router-metrics-certs-default" not found
Jul 10 18:59:12.106356 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:12.106302    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:20.106293111 +0000 UTC m=+59.562843475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : configmap references non-existent config key: service-ca.crt
Jul 10 18:59:12.206158 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:12.206130    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4g9f_7387df1d-ca1e-43e5-8092-9dc2a2e00328/dns-node-resolver/0.log"
Jul 10 18:59:12.207409 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:12.207389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:12.207476 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:12.207457    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:59:12.207476 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:12.207470    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b66d8cd-mgcng: secret "image-registry-tls" not found
Jul 10 18:59:12.207560 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:12.207518    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls podName:452f8c4a-8154-403d-a457-96cc8d4cf1d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:16.207505511 +0000 UTC m=+55.664055867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls") pod "image-registry-547b66d8cd-mgcng" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6") : secret "image-registry-tls" not found
Jul 10 18:59:12.830100 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:12.830065    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:12.930054 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:12.930013    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:13.198445 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:13.198394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:13.206795 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:13.206776    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zwmdv_84297d76-89dd-4b8f-96a2-07271e721443/node-ca/0.log"
Jul 10 18:59:13.294834 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:13.294792    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:13.318142 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:13.318110    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:13.318293 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:13.318197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:13.318293 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:13.318225    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:59:13.318293 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:13.318283    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm podName:fa064662-d006-4909-b0d9-39f99b2bbd38 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:17.318268095 +0000 UTC m=+56.774818452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5bfbm" (UID: "fa064662-d006-4909-b0d9-39f99b2bbd38") : configmap "kube-rbac-proxy" not found
Jul 10 18:59:13.318475 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:13.318323    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:13.318475 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:13.318403    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls podName:fa064662-d006-4909-b0d9-39f99b2bbd38 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:17.31836659 +0000 UTC m=+56.774916947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5bfbm" (UID: "fa064662-d006-4909-b0d9-39f99b2bbd38") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:13.557580 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:13.557480    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:13.606420 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:13.606364    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nb85_10f54178-163e-47c9-8a23-586879ffa3ba/serve-healthcheck-canary/0.log"
Jul 10 18:59:13.660675 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:13.660640    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:14.008786 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:14.008751    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:14.109824 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:14.109791    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:14.409511 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:14.409481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:14.508789 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:14.508724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:14.614555 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:14.614528    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:14.614662 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:14.614580    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:14.614896 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:14.614885    2579 scope.go:117] "RemoveContainer" containerID="3c779124b2fdf28b46d1bb9871159045d696e4efc5e5a370d3bc68d1a7486f9c"
Jul 10 18:59:14.615038 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:14.615022    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-67btj_openshift-console-operator(15852620-efcb-48e1-bf17-6073adc16659)\"" pod="openshift-console-operator/console-operator-7866497494-67btj" podUID="15852620-efcb-48e1-bf17-6073adc16659"
Jul 10 18:59:14.668251 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:14.668181    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:14.774317 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:14.774291    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:15.224499 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:15.224472    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:16.244020 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:16.243983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:16.244427 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:16.244090    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 18:59:16.244427 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:16.244101    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b66d8cd-mgcng: secret "image-registry-tls" not found
Jul 10 18:59:16.244427 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:16.244149    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls podName:452f8c4a-8154-403d-a457-96cc8d4cf1d6 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:24.244135893 +0000 UTC m=+63.700686249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls") pod "image-registry-547b66d8cd-mgcng" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6") : secret "image-registry-tls" not found
Jul 10 18:59:16.245443 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:16.245420    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:17.353121 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:17.353076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:17.353643 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:17.353170    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:17.353643 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:17.353221    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 18:59:17.353643 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:17.353270    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:17.353643 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:17.353317    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm podName:fa064662-d006-4909-b0d9-39f99b2bbd38 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:25.353293497 +0000 UTC m=+64.809843873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5bfbm" (UID: "fa064662-d006-4909-b0d9-39f99b2bbd38") : configmap "kube-rbac-proxy" not found
Jul 10 18:59:17.353643 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:17.353338    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls podName:fa064662-d006-4909-b0d9-39f99b2bbd38 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:25.353327546 +0000 UTC m=+64.809877903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5bfbm" (UID: "fa064662-d006-4909-b0d9-39f99b2bbd38") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:19.466402 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:19.466361    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:19.965486 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:19.965451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:20.075199 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:20.075163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:20.075342 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:20.075290    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 18:59:20.075422 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:20.075344    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls podName:a29a489e-0911-4526-8d05-fdd45e66b7ba nodeName:}" failed. No retries permitted until 2026-07-10 18:59:36.075330896 +0000 UTC m=+75.531881253 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls") pod "cluster-samples-operator-65db858894-62nlw" (UID: "a29a489e-0911-4526-8d05-fdd45e66b7ba") : secret "samples-operator-tls" not found
Jul 10 18:59:20.176431 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:20.176389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:20.176638 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:20.176480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:20.176638 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:20.176547    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:36.17652977 +0000 UTC m=+75.633080127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : configmap references non-existent config key: service-ca.crt
Jul 10 18:59:20.176638 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:20.176608    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 18:59:20.176773 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:20.176656    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs podName:fe60350d-1703-4cd7-b18a-deca0ffe4d54 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:36.176641398 +0000 UTC m=+75.633191772 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs") pod "router-default-6b8f9f9c6d-5bl7h" (UID: "fe60350d-1703-4cd7-b18a-deca0ffe4d54") : secret "router-metrics-certs-default" not found
Jul 10 18:59:20.286788 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:20.286717    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:20.370051 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:20.370022    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:20.530553 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:20.530517    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:20.638171 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:20.638138    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:20.767230 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:20.767198    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:21.468629 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:21.468592    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:22.065776 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:22.065745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:22.256785 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:22.256747    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:22.316986 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:22.316907    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:22.457935 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:22.457902    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:22.857031 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:22.856996    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:23.300154 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:23.300121    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qs4gh"
Jul 10 18:59:23.461738 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:23.461706    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:23.614552 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:23.614470    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:23.768664 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:23.768583    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:24.063489 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:24.063434    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:24.256098 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:24.256065    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:24.309685 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:24.309659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:24.311887 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:24.311856    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls\") pod \"image-registry-547b66d8cd-mgcng\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") " pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:24.409308 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:24.409281    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ndwz8\""
Jul 10 18:59:24.418126 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:24.418090    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:24.539642 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:24.539615    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-547b66d8cd-mgcng"]
Jul 10 18:59:24.542591 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:24.542564    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452f8c4a_8154_403d_a457_96cc8d4cf1d6.slice/crio-f89b7241ee38f2269535c598a3e128972603ec3bbf35ad7d774b54812025db3d WatchSource:0}: Error finding container f89b7241ee38f2269535c598a3e128972603ec3bbf35ad7d774b54812025db3d: Status 404 returned error can't find the container with id f89b7241ee38f2269535c598a3e128972603ec3bbf35ad7d774b54812025db3d
Jul 10 18:59:24.652143 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:24.652102    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:24.865343 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:24.865239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:25.268492 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:25.268443    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:25.391438 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:25.391393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng" event={"ID":"452f8c4a-8154-403d-a457-96cc8d4cf1d6","Type":"ContainerStarted","Data":"f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc"}
Jul 10 18:59:25.391905 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:25.391450    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng" event={"ID":"452f8c4a-8154-403d-a457-96cc8d4cf1d6","Type":"ContainerStarted","Data":"f89b7241ee38f2269535c598a3e128972603ec3bbf35ad7d774b54812025db3d"}
Jul 10 18:59:25.391905 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:25.391530    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:25.398565 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:25.398526    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:25.414621 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:25.414578    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng" podStartSLOduration=17.414564991 podStartE2EDuration="17.414564991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:25.413298717 +0000 UTC m=+64.869849095" watchObservedRunningTime="2026-07-10 18:59:25.414564991 +0000 UTC m=+64.871115368"
Jul 10 18:59:25.420504 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:25.420480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:25.420573 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:25.420545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:25.420649 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:25.420631    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:25.420703 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:25.420690    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls podName:fa064662-d006-4909-b0d9-39f99b2bbd38 nodeName:}" failed. No retries permitted until 2026-07-10 18:59:41.420676913 +0000 UTC m=+80.877227273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5bfbm" (UID: "fa064662-d006-4909-b0d9-39f99b2bbd38") : secret "insights-runtime-extractor-tls" not found
Jul 10 18:59:25.421052 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:25.421030    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa064662-d006-4909-b0d9-39f99b2bbd38-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:25.499772 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:25.499721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:25.867338 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:25.867301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:26.127771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.127739    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:26.263930 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.263892    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:26.655035 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.654999    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:26.732303 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.732267    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 18:59:26.732476 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.732327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:59:26.734787 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.734768    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 18:59:26.734902 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.734824    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 18:59:26.742866 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:26.742844    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 18:59:26.742917 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:26.742911    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs podName:03c8f640-6992-4fac-8c1d-802baf0a69d4 nodeName:}" failed. No retries permitted until 2026-07-10 19:00:30.742894289 +0000 UTC m=+130.199444654 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs") pod "network-metrics-daemon-w6cw9" (UID: "03c8f640-6992-4fac-8c1d-802baf0a69d4") : secret "metrics-daemon-secret" not found
Jul 10 18:59:26.744990 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.744962    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85-original-pull-secret\") pod \"global-pull-secret-syncer-xxrhq\" (UID: \"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85\") " pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:59:26.836057 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.836017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxrhq"
Jul 10 18:59:26.857856 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.857794    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:26.933930 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.933898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkjf\" (UniqueName: \"kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf\") pod \"network-check-target-sl68j\" (UID: \"c230e79e-35d4-49e0-b95c-1c994f296ba5\") " pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:59:26.936855 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.936830    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 18:59:26.948498 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.948477    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 18:59:26.957916 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.957886    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jkjf\" (UniqueName: \"kubernetes.io/projected/c230e79e-35d4-49e0-b95c-1c994f296ba5-kube-api-access-2jkjf\") pod \"network-check-target-sl68j\" (UID: \"c230e79e-35d4-49e0-b95c-1c994f296ba5\") " pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:59:26.962742 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:26.962715    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xxrhq"]
Jul 10 18:59:26.965485 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:26.965459    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2bb328d_1bb7_4f64_a0e2_5f2dd89ecf85.slice/crio-ca507a724456411940d007aaa47845c772969a930d090228f434e91d2041b513 WatchSource:0}: Error finding container ca507a724456411940d007aaa47845c772969a930d090228f434e91d2041b513: Status 404 returned error can't find the container with id ca507a724456411940d007aaa47845c772969a930d090228f434e91d2041b513
Jul 10 18:59:27.144149 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.144124    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k2x45\""
Jul 10 18:59:27.152552 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.152535    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:59:27.265722 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.265692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:27.275743 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.275718    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sl68j"]
Jul 10 18:59:27.278784 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:27.278753    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc230e79e_35d4_49e0_b95c_1c994f296ba5.slice/crio-3df7053883e57c54797a24544c725907d315700b2962598de33eac85a0867ebb WatchSource:0}: Error finding container 3df7053883e57c54797a24544c725907d315700b2962598de33eac85a0867ebb: Status 404 returned error can't find the container with id 3df7053883e57c54797a24544c725907d315700b2962598de33eac85a0867ebb
Jul 10 18:59:27.338190 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.338152    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:59:27.340410 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.340388    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e979646e-840e-4a43-8aff-705dbdc1f116-metrics-tls\") pod \"dns-default-m7bqv\" (UID: \"e979646e-840e-4a43-8aff-705dbdc1f116\") " pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:59:27.398171 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.398137    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sl68j" event={"ID":"c230e79e-35d4-49e0-b95c-1c994f296ba5","Type":"ContainerStarted","Data":"3df7053883e57c54797a24544c725907d315700b2962598de33eac85a0867ebb"}
Jul 10 18:59:27.399174 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.399153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xxrhq" event={"ID":"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85","Type":"ContainerStarted","Data":"ca507a724456411940d007aaa47845c772969a930d090228f434e91d2041b513"}
Jul 10 18:59:27.490107 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.490018    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-99kdr\""
Jul 10 18:59:27.498257 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.498236    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:59:27.669940 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.669869    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7bqv"]
Jul 10 18:59:27.673709 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:27.673671    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode979646e_840e_4a43_8aff_705dbdc1f116.slice/crio-cc17fc6deb90460be9fe2167163fd63ee2d71e21d2edfce1865fa4f499ffee7f WatchSource:0}: Error finding container cc17fc6deb90460be9fe2167163fd63ee2d71e21d2edfce1865fa4f499ffee7f: Status 404 returned error can't find the container with id cc17fc6deb90460be9fe2167163fd63ee2d71e21d2edfce1865fa4f499ffee7f
Jul 10 18:59:27.899272 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:27.899242    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:28.093989 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:28.093951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:28.290943 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:28.290853    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:28.405450 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:28.405412    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7bqv" event={"ID":"e979646e-840e-4a43-8aff-705dbdc1f116","Type":"ContainerStarted","Data":"cc17fc6deb90460be9fe2167163fd63ee2d71e21d2edfce1865fa4f499ffee7f"}
Jul 10 18:59:28.479073 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:28.479037    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:29.059868 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:29.059832    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:29.117565 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:29.117515    2579 scope.go:117] "RemoveContainer" containerID="3c779124b2fdf28b46d1bb9871159045d696e4efc5e5a370d3bc68d1a7486f9c"
Jul 10 18:59:29.471289 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:29.471251    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:29.908824 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:29.908793    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:30.269272 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:30.269178    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:30.515460 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:30.515425    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:30.671777 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:30.671740    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:32.420706 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.420634    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 18:59:32.421123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.420731    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-67btj" event={"ID":"15852620-efcb-48e1-bf17-6073adc16659","Type":"ContainerStarted","Data":"66ef898593c42385dc82c455e21cd921c6b2d5141f19b2afced61bf884499198"}
Jul 10 18:59:32.421123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.421050    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:32.422495 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.422468    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sl68j" event={"ID":"c230e79e-35d4-49e0-b95c-1c994f296ba5","Type":"ContainerStarted","Data":"bf9c6c0dae01382b21c7679bb9ed9a3b61f2871cc5e30d13edcdbd2723771110"}
Jul 10 18:59:32.422607 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.422564    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 18:59:32.424045 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.424019    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xxrhq" event={"ID":"b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85","Type":"ContainerStarted","Data":"dc6828902a184ca6ad0d9a1f993903dd2a20b6ccd1957a62b800114a4e094b75"}
Jul 10 18:59:32.425676 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.425651    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7bqv" event={"ID":"e979646e-840e-4a43-8aff-705dbdc1f116","Type":"ContainerStarted","Data":"393aef90275a60eb215cea02101b2b06862038f69149a0fbc6c6df77ee8c72cb"}
Jul 10 18:59:32.425780 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.425692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7bqv" event={"ID":"e979646e-840e-4a43-8aff-705dbdc1f116","Type":"ContainerStarted","Data":"bb63f49465d1a80b1c151b9d0423dfd621b1e7290810f30993a53802596218fe"}
Jul 10 18:59:32.425780 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.425772    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:59:32.444676 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.444627    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-67btj" podStartSLOduration=25.264120134 podStartE2EDuration="28.444614514s" totalImagesPullingTime="3.18049438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:32.444230176 +0000 UTC m=+71.900780553" watchObservedRunningTime="2026-07-10 18:59:32.444614514 +0000 UTC m=+71.901164891"
Jul 10 18:59:32.469613 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.469571    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sl68j" podStartSLOduration=66.810214554 podStartE2EDuration="1m11.469554906s" totalImagesPullingTime="4.659340352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:32.469004424 +0000 UTC m=+71.925554812" watchObservedRunningTime="2026-07-10 18:59:32.469554906 +0000 UTC m=+71.926105275"
Jul 10 18:59:32.494273 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.494230    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m7bqv" podStartSLOduration=33.23693468 podStartE2EDuration="37.494218418s" totalImagesPullingTime="4.257283738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:32.493868964 +0000 UTC m=+71.950419357" watchObservedRunningTime="2026-07-10 18:59:32.494218418 +0000 UTC m=+71.950768796"
Jul 10 18:59:32.514586 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:32.514546    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xxrhq" podStartSLOduration=66.533905049 podStartE2EDuration="1m11.514533806s" totalImagesPullingTime="4.980628757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:32.513815064 +0000 UTC m=+71.970365442" watchObservedRunningTime="2026-07-10 18:59:32.514533806 +0000 UTC m=+71.971084206"
Jul 10 18:59:33.063604 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:33.063572    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-67btj"
Jul 10 18:59:33.276128 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:33.276094    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:33.376221 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:33.376189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:33.435422 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:33.435393    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:33.571250 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:33.571217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:33.727536 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:33.727454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:33.934060 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:33.934025    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:34.127280 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:34.127247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:34.226649 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:34.226616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:35.135187 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:35.135158    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:35.343051 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:35.343023    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:35.415356 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:35.415279    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:35.515628 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:35.515596    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:36.119323 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.119285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:36.121736 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.121711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a29a489e-0911-4526-8d05-fdd45e66b7ba-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-62nlw\" (UID: \"a29a489e-0911-4526-8d05-fdd45e66b7ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:36.158531 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.158492    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:36.220420 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.220362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:36.220608 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.220447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:36.221034 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.221008    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe60350d-1703-4cd7-b18a-deca0ffe4d54-service-ca-bundle\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:36.222687 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.222651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe60350d-1703-4cd7-b18a-deca0ffe4d54-metrics-certs\") pod \"router-default-6b8f9f9c6d-5bl7h\" (UID: \"fe60350d-1703-4cd7-b18a-deca0ffe4d54\") " pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:36.260527 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.260487    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:36.396549 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.396519    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mhsg4\""
Jul 10 18:59:36.404864 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.404846    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"
Jul 10 18:59:36.473361 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.473332    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-698r5\""
Jul 10 18:59:36.481482 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.481437    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:36.535123 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.535045    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw"]
Jul 10 18:59:36.636726 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:36.636693    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b8f9f9c6d-5bl7h"]
Jul 10 18:59:36.639526 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:36.639500    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe60350d_1703_4cd7_b18a_deca0ffe4d54.slice/crio-752e109d27fe96e2b590feb41fe62ee7a1019baf596fc5dd4a19e81578dcb7d0 WatchSource:0}: Error finding container 752e109d27fe96e2b590feb41fe62ee7a1019baf596fc5dd4a19e81578dcb7d0: Status 404 returned error can't find the container with id 752e109d27fe96e2b590feb41fe62ee7a1019baf596fc5dd4a19e81578dcb7d0
Jul 10 18:59:37.444593 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:37.444546    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw" event={"ID":"a29a489e-0911-4526-8d05-fdd45e66b7ba","Type":"ContainerStarted","Data":"b7a731fe4c39d59f836903f5a60e083ad8d8bf471d779d2f7ee03533eb17aca3"}
Jul 10 18:59:37.446255 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:37.446215    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h" event={"ID":"fe60350d-1703-4cd7-b18a-deca0ffe4d54","Type":"ContainerStarted","Data":"99751f5b174d33b585da3d0b101cee18abc3e3f3bbbd41e7a5a11b10840926bf"}
Jul 10 18:59:37.446418 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:37.446272    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h" event={"ID":"fe60350d-1703-4cd7-b18a-deca0ffe4d54","Type":"ContainerStarted","Data":"752e109d27fe96e2b590feb41fe62ee7a1019baf596fc5dd4a19e81578dcb7d0"}
Jul 10 18:59:37.469032 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:37.468975    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h" podStartSLOduration=33.468955046 podStartE2EDuration="33.468955046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:37.46745349 +0000 UTC m=+76.924003891" watchObservedRunningTime="2026-07-10 18:59:37.468955046 +0000 UTC m=+76.925505423"
Jul 10 18:59:37.482191 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:37.482160    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:37.484636 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:37.484606    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:38.451805 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.451768    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw" event={"ID":"a29a489e-0911-4526-8d05-fdd45e66b7ba","Type":"ContainerStarted","Data":"dd1350d829c1b12019e89614a9dbf54d0526a447c5d1326dbde2276f2ef48c0b"}
Jul 10 18:59:38.452169 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.451826    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw" event={"ID":"a29a489e-0911-4526-8d05-fdd45e66b7ba","Type":"ContainerStarted","Data":"f3e511b884fc4e44662120bf20948aae58853fb1cc2c584f4bfa954db01769ce"}
Jul 10 18:59:38.452169 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.452044    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:38.453203 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.453183    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b8f9f9c6d-5bl7h"
Jul 10 18:59:38.482827 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.482779    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-62nlw" podStartSLOduration=33.055165315 podStartE2EDuration="34.482765599s" totalImagesPullingTime="1.427600284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:38.481853216 +0000 UTC m=+77.938403613" watchObservedRunningTime="2026-07-10 18:59:38.482765599 +0000 UTC m=+77.939316028"
Jul 10 18:59:38.574798 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.574755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:38.678346 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.678302    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:38.872527 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.872499    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:38.968674 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.968647    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-547b66d8cd-mgcng"]
Jul 10 18:59:38.973060 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.973036    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w"]
Jul 10 18:59:38.976108 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.976086    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-vxfjr"]
Jul 10 18:59:38.976209 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.976191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w"
Jul 10 18:59:38.979156 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.979139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-vxfjr"
Jul 10 18:59:38.980198 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.980181    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-p7xft\""
Jul 10 18:59:38.980584 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.980564    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 10 18:59:38.981438 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.981421    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 18:59:38.983491 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.983475    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nm495\""
Jul 10 18:59:38.984103 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.984084    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 18:59:38.988660 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.988633    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w"]
Jul 10 18:59:38.993016 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:38.992312    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-vxfjr"]
Jul 10 18:59:39.065745 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.065708    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-575dcb8698-5sssc"]
Jul 10 18:59:39.068839 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.068816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.082298 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.082267    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:39.089833 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.089801    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-575dcb8698-5sssc"]
Jul 10 18:59:39.143415 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.143321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a1ede2a-937b-4ecf-88e1-31f33dde4ada-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-lgp7w\" (UID: \"2a1ede2a-937b-4ecf-88e1-31f33dde4ada\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w"
Jul 10 18:59:39.143559 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.143422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gstks\" (UniqueName: \"kubernetes.io/projected/bf49778f-47da-41d3-986b-fc2a08ad48e7-kube-api-access-gstks\") pod \"downloads-68c9cbb497-vxfjr\" (UID: \"bf49778f-47da-41d3-986b-fc2a08ad48e7\") " pod="openshift-console/downloads-68c9cbb497-vxfjr"
Jul 10 18:59:39.196148 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.196109    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:39.244314 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.244277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c4e86ad-dc68-4191-8867-3f99be4adb48-registry-tls\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.244477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.244319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c4e86ad-dc68-4191-8867-3f99be4adb48-image-registry-private-configuration\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.244477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.244357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a1ede2a-937b-4ecf-88e1-31f33dde4ada-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-lgp7w\" (UID: \"2a1ede2a-937b-4ecf-88e1-31f33dde4ada\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w"
Jul 10 18:59:39.244477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.244410    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c4e86ad-dc68-4191-8867-3f99be4adb48-installation-pull-secrets\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.244477 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.244442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c4e86ad-dc68-4191-8867-3f99be4adb48-ca-trust-extracted\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.244689 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.244482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c4e86ad-dc68-4191-8867-3f99be4adb48-trusted-ca\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.244689 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.244510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gstks\" (UniqueName: \"kubernetes.io/projected/bf49778f-47da-41d3-986b-fc2a08ad48e7-kube-api-access-gstks\") pod \"downloads-68c9cbb497-vxfjr\" (UID: \"bf49778f-47da-41d3-986b-fc2a08ad48e7\") " pod="openshift-console/downloads-68c9cbb497-vxfjr"
Jul 10 18:59:39.244689 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.244540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c4e86ad-dc68-4191-8867-3f99be4adb48-bound-sa-token\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.244689 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.244629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l22gr\" (UniqueName: \"kubernetes.io/projected/1c4e86ad-dc68-4191-8867-3f99be4adb48-kube-api-access-l22gr\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.244857 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.244688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c4e86ad-dc68-4191-8867-3f99be4adb48-registry-certificates\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.246774 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.246750    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a1ede2a-937b-4ecf-88e1-31f33dde4ada-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-lgp7w\" (UID: \"2a1ede2a-937b-4ecf-88e1-31f33dde4ada\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w"
Jul 10 18:59:39.256746 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.256712    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gstks\" (UniqueName: \"kubernetes.io/projected/bf49778f-47da-41d3-986b-fc2a08ad48e7-kube-api-access-gstks\") pod \"downloads-68c9cbb497-vxfjr\" (UID: \"bf49778f-47da-41d3-986b-fc2a08ad48e7\") " pod="openshift-console/downloads-68c9cbb497-vxfjr"
Jul 10 18:59:39.287094 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.287057    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w"
Jul 10 18:59:39.288403 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.288353    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:39.295125 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.295101    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-vxfjr"
Jul 10 18:59:39.346209 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.346103    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c4e86ad-dc68-4191-8867-3f99be4adb48-registry-certificates\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.346209 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.346192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c4e86ad-dc68-4191-8867-3f99be4adb48-registry-tls\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.346437 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.346234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c4e86ad-dc68-4191-8867-3f99be4adb48-image-registry-private-configuration\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.346437 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.346276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c4e86ad-dc68-4191-8867-3f99be4adb48-installation-pull-secrets\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.346437 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.346311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c4e86ad-dc68-4191-8867-3f99be4adb48-ca-trust-extracted\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.346437 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.346361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c4e86ad-dc68-4191-8867-3f99be4adb48-trusted-ca\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.346634 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.346410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c4e86ad-dc68-4191-8867-3f99be4adb48-bound-sa-token\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.346634 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.346586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22gr\" (UniqueName: \"kubernetes.io/projected/1c4e86ad-dc68-4191-8867-3f99be4adb48-kube-api-access-l22gr\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.347296 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.347064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c4e86ad-dc68-4191-8867-3f99be4adb48-registry-certificates\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.347671 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.347647    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c4e86ad-dc68-4191-8867-3f99be4adb48-ca-trust-extracted\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.348013 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.347985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c4e86ad-dc68-4191-8867-3f99be4adb48-trusted-ca\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.351150 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.350317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c4e86ad-dc68-4191-8867-3f99be4adb48-registry-tls\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.351150 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.350830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c4e86ad-dc68-4191-8867-3f99be4adb48-image-registry-private-configuration\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.351678 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.351640    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c4e86ad-dc68-4191-8867-3f99be4adb48-installation-pull-secrets\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.364629 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.364569    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c4e86ad-dc68-4191-8867-3f99be4adb48-bound-sa-token\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.365127 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.365087    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l22gr\" (UniqueName: \"kubernetes.io/projected/1c4e86ad-dc68-4191-8867-3f99be4adb48-kube-api-access-l22gr\") pod \"image-registry-575dcb8698-5sssc\" (UID: \"1c4e86ad-dc68-4191-8867-3f99be4adb48\") " pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.377984 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.377950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:39.430771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.430736    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w"]
Jul 10 18:59:39.436628 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:39.436581    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a1ede2a_937b_4ecf_88e1_31f33dde4ada.slice/crio-28c1945769852dc99b49b68fb72cdf3fed2c8dee1d3b8e803b9fd46adb09fa72 WatchSource:0}: Error finding container 28c1945769852dc99b49b68fb72cdf3fed2c8dee1d3b8e803b9fd46adb09fa72: Status 404 returned error can't find the container with id 28c1945769852dc99b49b68fb72cdf3fed2c8dee1d3b8e803b9fd46adb09fa72
Jul 10 18:59:39.451688 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.451656    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-vxfjr"]
Jul 10 18:59:39.456445 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.456410    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w" event={"ID":"2a1ede2a-937b-4ecf-88e1-31f33dde4ada","Type":"ContainerStarted","Data":"28c1945769852dc99b49b68fb72cdf3fed2c8dee1d3b8e803b9fd46adb09fa72"}
Jul 10 18:59:39.456819 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:39.456654    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf49778f_47da_41d3_986b_fc2a08ad48e7.slice/crio-8b92d90e52f6d89be2347bd87457ad7061adcfce24c8cbbba331ede6c5a721cb WatchSource:0}: Error finding container 8b92d90e52f6d89be2347bd87457ad7061adcfce24c8cbbba331ede6c5a721cb: Status 404 returned error can't find the container with id 8b92d90e52f6d89be2347bd87457ad7061adcfce24c8cbbba331ede6c5a721cb
Jul 10 18:59:39.521408 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.521360    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-575dcb8698-5sssc"]
Jul 10 18:59:39.525611 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:39.525576    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4e86ad_dc68_4191_8867_3f99be4adb48.slice/crio-ae9ffd6bc117bf36949ab81320ed6e1ed188654e5d863fc339895a551b7d6bb5 WatchSource:0}: Error finding container ae9ffd6bc117bf36949ab81320ed6e1ed188654e5d863fc339895a551b7d6bb5: Status 404 returned error can't find the container with id ae9ffd6bc117bf36949ab81320ed6e1ed188654e5d863fc339895a551b7d6bb5
Jul 10 18:59:39.700443 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:39.700335    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:40.461753 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:40.461703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-575dcb8698-5sssc" event={"ID":"1c4e86ad-dc68-4191-8867-3f99be4adb48","Type":"ContainerStarted","Data":"82c2f4c7337afec1cd33f87dff992335332125223e4e0720fc311d1c67785390"}
Jul 10 18:59:40.462238 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:40.461769    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-575dcb8698-5sssc" event={"ID":"1c4e86ad-dc68-4191-8867-3f99be4adb48","Type":"ContainerStarted","Data":"ae9ffd6bc117bf36949ab81320ed6e1ed188654e5d863fc339895a551b7d6bb5"}
Jul 10 18:59:40.462238 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:40.461796    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 18:59:40.463175 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:40.463147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-vxfjr" event={"ID":"bf49778f-47da-41d3-986b-fc2a08ad48e7","Type":"ContainerStarted","Data":"8b92d90e52f6d89be2347bd87457ad7061adcfce24c8cbbba331ede6c5a721cb"}
Jul 10 18:59:40.484484 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:40.484298    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-575dcb8698-5sssc" podStartSLOduration=1.4842771479999999 podStartE2EDuration="1.484277148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:40.481976551 +0000 UTC m=+79.938526955" watchObservedRunningTime="2026-07-10 18:59:40.484277148 +0000 UTC m=+79.940827523"
Jul 10 18:59:41.464339 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.464305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:41.469674 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.468081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa064662-d006-4909-b0d9-39f99b2bbd38-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5bfbm\" (UID: \"fa064662-d006-4909-b0d9-39f99b2bbd38\") " pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:41.472530 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.472490    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w" event={"ID":"2a1ede2a-937b-4ecf-88e1-31f33dde4ada","Type":"ContainerStarted","Data":"7148f4ac0e9b37151ec15eb1bce80929af3bf9d0a52c53621569f0ca3b58f3d1"}
Jul 10 18:59:41.472917 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.472851    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w"
Jul 10 18:59:41.478177 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.478152    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w"
Jul 10 18:59:41.491387 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.491322    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-lgp7w" podStartSLOduration=2.250830136 podStartE2EDuration="3.491308692s" totalImagesPullingTime="1.240478556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:41.489754497 +0000 UTC m=+80.946304875" watchObservedRunningTime="2026-07-10 18:59:41.491308692 +0000 UTC m=+80.947859069"
Jul 10 18:59:41.765802 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.765725    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2qznj\""
Jul 10 18:59:41.773822 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.773782    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5bfbm"
Jul 10 18:59:41.936274 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.936242    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:41.936452 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.936314    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5bfbm"]
Jul 10 18:59:41.939764 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:41.939731    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa064662_d006_4909_b0d9_39f99b2bbd38.slice/crio-01a49bcc5154b6a8f7924710f963f7d9a559d18c1c25826d05aeb6e70e816728 WatchSource:0}: Error finding container 01a49bcc5154b6a8f7924710f963f7d9a559d18c1c25826d05aeb6e70e816728: Status 404 returned error can't find the container with id 01a49bcc5154b6a8f7924710f963f7d9a559d18c1c25826d05aeb6e70e816728
Jul 10 18:59:41.982025 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.981992    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dgl6b"]
Jul 10 18:59:41.995597 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.995570    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:41.998834 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:41.998800    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dgl6b"]
Jul 10 18:59:42.000951 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.000928    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 18:59:42.001070 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.000973    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 10 18:59:42.001070 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.001011    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bv7wt\""
Jul 10 18:59:42.001274 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.001255    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 18:59:42.001524 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.001504    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 18:59:42.001640 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.001621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 10 18:59:42.025218 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.025144    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:42.171999 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.171963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c358503-152f-4fc4-8738-a5206c71af1a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.171999 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.172002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8w4z\" (UniqueName: \"kubernetes.io/projected/3c358503-152f-4fc4-8738-a5206c71af1a-kube-api-access-d8w4z\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.172239 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.172034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c358503-152f-4fc4-8738-a5206c71af1a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.172239 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.172131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c358503-152f-4fc4-8738-a5206c71af1a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.273202 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.273165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c358503-152f-4fc4-8738-a5206c71af1a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.273202 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.273203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8w4z\" (UniqueName: \"kubernetes.io/projected/3c358503-152f-4fc4-8738-a5206c71af1a-kube-api-access-d8w4z\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.273576 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.273225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c358503-152f-4fc4-8738-a5206c71af1a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.273576 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.273247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c358503-152f-4fc4-8738-a5206c71af1a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.273576 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:42.273342    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 10 18:59:42.273576 ip-10-0-131-123 kubenswrapper[2579]: E0710 18:59:42.273415    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c358503-152f-4fc4-8738-a5206c71af1a-prometheus-operator-tls podName:3c358503-152f-4fc4-8738-a5206c71af1a nodeName:}" failed. No retries permitted until 2026-07-10 18:59:42.773397714 +0000 UTC m=+82.229948087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3c358503-152f-4fc4-8738-a5206c71af1a-prometheus-operator-tls") pod "prometheus-operator-64785b6675-dgl6b" (UID: "3c358503-152f-4fc4-8738-a5206c71af1a") : secret "prometheus-operator-tls" not found
Jul 10 18:59:42.273970 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.273945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c358503-152f-4fc4-8738-a5206c71af1a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.275667 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.275607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c358503-152f-4fc4-8738-a5206c71af1a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.281539 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.281507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8w4z\" (UniqueName: \"kubernetes.io/projected/3c358503-152f-4fc4-8738-a5206c71af1a-kube-api-access-d8w4z\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.431153 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.431118    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m7bqv"
Jul 10 18:59:42.481470 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.481306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5bfbm" event={"ID":"fa064662-d006-4909-b0d9-39f99b2bbd38","Type":"ContainerStarted","Data":"01a49bcc5154b6a8f7924710f963f7d9a559d18c1c25826d05aeb6e70e816728"}
Jul 10 18:59:42.551895 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.551807    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:42.778327 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.778223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c358503-152f-4fc4-8738-a5206c71af1a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.788333 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.783558    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c358503-152f-4fc4-8738-a5206c71af1a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dgl6b\" (UID: \"3c358503-152f-4fc4-8738-a5206c71af1a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:42.909095 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:42.909056    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b"
Jul 10 18:59:43.104977 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:43.104951    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dgl6b"]
Jul 10 18:59:43.157984 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:43.157899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:43.213849 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:43.213741    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:43.487096 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:43.486899    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b" event={"ID":"3c358503-152f-4fc4-8738-a5206c71af1a","Type":"ContainerStarted","Data":"bac8185892580a6c1a308da6187ffb86f0eae4bd144fc553a318add83f1a2677"}
Jul 10 18:59:45.998272 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:45.998234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:46.099532 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:46.099487    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:46.886076 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:46.886042    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:47.504857 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:47.504817    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5bfbm" event={"ID":"fa064662-d006-4909-b0d9-39f99b2bbd38","Type":"ContainerStarted","Data":"901f95999729429c4eae7bc0722ce979c333155499659a72253a1d9d7c748c83"}
Jul 10 18:59:47.505276 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:47.504884    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5bfbm" event={"ID":"fa064662-d006-4909-b0d9-39f99b2bbd38","Type":"ContainerStarted","Data":"106b0828cf0795d4cd4d4720b6d17a39a2b6b56f6936a6e73cd3ddbe134ae301"}
Jul 10 18:59:47.506443 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:47.506421    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b" event={"ID":"3c358503-152f-4fc4-8738-a5206c71af1a","Type":"ContainerStarted","Data":"bdcb6c16ab39143c4c7a7b97ee56914cf0a34473c9b00d48b6567d5a208f8d1b"}
Jul 10 18:59:47.506522 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:47.506465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b" event={"ID":"3c358503-152f-4fc4-8738-a5206c71af1a","Type":"ContainerStarted","Data":"353d1af7c0d41c48f8099a46eedf29bb9489569e19f88cab3967ef52376ca0d6"}
Jul 10 18:59:47.534543 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:47.534489    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-dgl6b" podStartSLOduration=3.102869468 podStartE2EDuration="6.534473115s" totalImagesPullingTime="3.431603647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:47.533047221 +0000 UTC m=+86.989597598" watchObservedRunningTime="2026-07-10 18:59:47.534473115 +0000 UTC m=+86.991023471"
Jul 10 18:59:47.845062 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:47.845022    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:47.961559 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:47.961524    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:48.071694 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:48.071642    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:48.796043 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:48.795973    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:48.890388 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:48.890344    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:48.977527 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:48.977461    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 18:59:49.157576 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.157520    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:49.501655 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.501534    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:49.630513 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.630349    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k5vrp"]
Jul 10 18:59:49.641488 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.641451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:49.644626 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.644596    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.648147 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.647763    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 18:59:49.648147 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.648009    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j22gr\""
Jul 10 18:59:49.648147 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.648143    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 18:59:49.648362 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.648317    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 18:59:49.666764 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.666729    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-f64sw"]
Jul 10 18:59:49.671830 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.671795    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.676181 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.676137    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qh4ml\""
Jul 10 18:59:49.676655 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.676618    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 10 18:59:49.677157 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.677135    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 10 18:59:49.677254 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.677145    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 10 18:59:49.689114 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.689076    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-f64sw"]
Jul 10 18:59:49.742981 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.742938    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e85202e-30a4-40e6-8c88-d046b5db0c33-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.742981 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.742993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-tls\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.743238 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-wtmp\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.743238 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-textfile\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.743238 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743196    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbqnv\" (UniqueName: \"kubernetes.io/projected/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-kube-api-access-jbqnv\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.743238 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743222    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-sys\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.743386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.743386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743284    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.743386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743306    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.743386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff979\" (UniqueName: \"kubernetes.io/projected/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-api-access-ff979\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.743386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.743386 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743363    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-root\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.743605 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.743605 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e85202e-30a4-40e6-8c88-d046b5db0c33-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.743605 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.743526    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-metrics-client-ca\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.749277 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.749245    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:49.844402 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.844402 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff979\" (UniqueName: \"kubernetes.io/projected/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-api-access-ff979\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-root\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e85202e-30a4-40e6-8c88-d046b5db0c33-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-metrics-client-ca\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e85202e-30a4-40e6-8c88-d046b5db0c33-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-tls\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-wtmp\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-textfile\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbqnv\" (UniqueName: \"kubernetes.io/projected/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-kube-api-access-jbqnv\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.844912 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-sys\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.845571 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.844928    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-sys\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.845571 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.845022    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.845571 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.845056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-wtmp\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.845571 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.845114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.845571 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.845273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-metrics-client-ca\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.845571 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.845408    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-root\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.845571 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.845428    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e85202e-30a4-40e6-8c88-d046b5db0c33-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.845924 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.845598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2e85202e-30a4-40e6-8c88-d046b5db0c33-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.845924 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.845775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-textfile\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.848198 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.848176    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.848345 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.848305    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-node-exporter-tls\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.849016 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.848993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.849086 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.849057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.854003 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.853967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbqnv\" (UniqueName: \"kubernetes.io/projected/d801d62b-f25d-4dc9-bd05-d04d2a83ca9a-kube-api-access-jbqnv\") pod \"node-exporter-k5vrp\" (UID: \"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a\") " pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.854120 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.854103    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff979\" (UniqueName: \"kubernetes.io/projected/2e85202e-30a4-40e6-8c88-d046b5db0c33-kube-api-access-ff979\") pod \"kube-state-metrics-785778ff74-f64sw\" (UID: \"2e85202e-30a4-40e6-8c88-d046b5db0c33\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:49.957478 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.957439    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k5vrp"
Jul 10 18:59:49.983391 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:49.983342    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw"
Jul 10 18:59:50.055252 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:50.055198    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd801d62b_f25d_4dc9_bd05_d04d2a83ca9a.slice/crio-e00f9a5822b3d03713721b98c5912cc58f969b73421a9f8075378fe117e0a63f WatchSource:0}: Error finding container e00f9a5822b3d03713721b98c5912cc58f969b73421a9f8075378fe117e0a63f: Status 404 returned error can't find the container with id e00f9a5822b3d03713721b98c5912cc58f969b73421a9f8075378fe117e0a63f
Jul 10 18:59:50.087864 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:50.087823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:50.203827 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:50.203795    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-f64sw"]
Jul 10 18:59:50.207119 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:50.207093    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e85202e_30a4_40e6_8c88_d046b5db0c33.slice/crio-ecf885a7ee40ce2dbff0dcd15670b650d79b615e08434786782668b6ce2a44c8 WatchSource:0}: Error finding container ecf885a7ee40ce2dbff0dcd15670b650d79b615e08434786782668b6ce2a44c8: Status 404 returned error can't find the container with id ecf885a7ee40ce2dbff0dcd15670b650d79b615e08434786782668b6ce2a44c8
Jul 10 18:59:50.348727 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:50.348694    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:50.450731 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:50.450697    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:50.522539 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:50.522440    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5bfbm" event={"ID":"fa064662-d006-4909-b0d9-39f99b2bbd38","Type":"ContainerStarted","Data":"dd3f056b2d5b576e2df5a0134eaba7a903307bb8641eee4a6b57be18da86937b"}
Jul 10 18:59:50.523938 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:50.523901    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw" event={"ID":"2e85202e-30a4-40e6-8c88-d046b5db0c33","Type":"ContainerStarted","Data":"ecf885a7ee40ce2dbff0dcd15670b650d79b615e08434786782668b6ce2a44c8"}
Jul 10 18:59:50.525884 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:50.525859    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k5vrp" event={"ID":"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a","Type":"ContainerStarted","Data":"e00f9a5822b3d03713721b98c5912cc58f969b73421a9f8075378fe117e0a63f"}
Jul 10 18:59:50.555809 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:50.555742    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5bfbm" podStartSLOduration=33.555645106 podStartE2EDuration="41.555719773s" totalImagesPullingTime="8.000074667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:59:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:50.555400735 +0000 UTC m=+90.011951135" watchObservedRunningTime="2026-07-10 18:59:50.555719773 +0000 UTC m=+90.012270152"
Jul 10 18:59:50.645515 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:50.645483    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:50.847084 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:50.846997    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:52.651415 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:52.651360    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:52.907265 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:52.907160    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:53.130882 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:53.130839    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:54.201088 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:54.201047    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:54.350362 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:54.350322    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:54.735152 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:54.735092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:54.837029 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:54.836957    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:55.914928 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:55.914856    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:58.375921 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.375643    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b5998c559-9rkp6"]
Jul 10 18:59:58.377789 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.377745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:58.388070 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.388049    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.391195 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.390815    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5998c559-9rkp6"]
Jul 10 18:59:58.391195 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.390816    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 18:59:58.391195 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.390943    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 18:59:58.391195 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.391007    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 18:59:58.391195 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.391142    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 18:59:58.391195 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.391159    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 18:59:58.391814 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.391793    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d6shc\""
Jul 10 18:59:58.402121 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.402093    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 18:59:58.425580 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.425550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-oauth-serving-cert\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.425728 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.425602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-service-ca\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.425728 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.425665    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-config\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.425842 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.425769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-trusted-ca-bundle\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.425842 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.425830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-oauth-config\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.425933 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.425899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-serving-cert\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.425972 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.425937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdjwh\" (UniqueName: \"kubernetes.io/projected/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-kube-api-access-fdjwh\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.440462 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.440411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 18:59:58.526625 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.526603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-oauth-config\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.526747 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.526644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-serving-cert\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.526747 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.526670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdjwh\" (UniqueName: \"kubernetes.io/projected/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-kube-api-access-fdjwh\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.526747 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.526702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-oauth-serving-cert\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.526914 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.526752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-service-ca\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.526914 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.526784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-config\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.526914 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.526851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-trusted-ca-bundle\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.527883 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.527806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-trusted-ca-bundle\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.527883 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.527826    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-oauth-serving-cert\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.527883 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.527873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-config\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.528212 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.528165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-service-ca\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.530110 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.529962    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-oauth-config\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.530193 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.530168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-serving-cert\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.535999 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.535975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdjwh\" (UniqueName: \"kubernetes.io/projected/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-kube-api-access-fdjwh\") pod \"console-6b5998c559-9rkp6\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") " pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:58.707076 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:58.706962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 18:59:59.199793 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.199525    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5998c559-9rkp6"]
Jul 10 18:59:59.203424 ip-10-0-131-123 kubenswrapper[2579]: W0710 18:59:59.203388    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf6d276_a76d_4e98_a1df_0d0f96dfa163.slice/crio-44fea8658802538786b45e4076ac97b66e9626a5ea1f32d060b4fca875e3b7b9 WatchSource:0}: Error finding container 44fea8658802538786b45e4076ac97b66e9626a5ea1f32d060b4fca875e3b7b9: Status 404 returned error can't find the container with id 44fea8658802538786b45e4076ac97b66e9626a5ea1f32d060b4fca875e3b7b9
Jul 10 18:59:59.566836 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.566735    2579 generic.go:356] "Generic (PLEG): container finished" podID="d801d62b-f25d-4dc9-bd05-d04d2a83ca9a" containerID="5ff2f19dd03b25f0728d3b896f6f4785640035323e9612b1d7a3aa38570e7f05" exitCode=0
Jul 10 18:59:59.567405 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.566838    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k5vrp" event={"ID":"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a","Type":"ContainerDied","Data":"5ff2f19dd03b25f0728d3b896f6f4785640035323e9612b1d7a3aa38570e7f05"}
Jul 10 18:59:59.568771 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.568745    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-vxfjr" event={"ID":"bf49778f-47da-41d3-986b-fc2a08ad48e7","Type":"ContainerStarted","Data":"bdc4afc29418222f6dfec7c6db715e7cb876eb1bc5f2967b1d023dd40ec6cad5"}
Jul 10 18:59:59.568942 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.568903    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-vxfjr"
Jul 10 18:59:59.571905 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.571866    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw" event={"ID":"2e85202e-30a4-40e6-8c88-d046b5db0c33","Type":"ContainerStarted","Data":"cdb79f1f181bd1e5781f6aa8bf7169618f64fe393cdb38d557b12c9ad0b79677"}
Jul 10 18:59:59.572018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.571928    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw" event={"ID":"2e85202e-30a4-40e6-8c88-d046b5db0c33","Type":"ContainerStarted","Data":"8cc6256ebc3a4be9bbeb149131ad2a77c4e1c229e88bf9c921408f69b84708be"}
Jul 10 18:59:59.572018 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.571960    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw" event={"ID":"2e85202e-30a4-40e6-8c88-d046b5db0c33","Type":"ContainerStarted","Data":"63ef0d45fb8ad49d48a078fc13a906609aaa80543927e011441b5afb641908ad"}
Jul 10 18:59:59.573289 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.573265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5998c559-9rkp6" event={"ID":"0bf6d276-a76d-4e98-a1df-0d0f96dfa163","Type":"ContainerStarted","Data":"44fea8658802538786b45e4076ac97b66e9626a5ea1f32d060b4fca875e3b7b9"}
Jul 10 18:59:59.583506 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.583480    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-vxfjr"
Jul 10 18:59:59.614552 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.614486    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-f64sw" podStartSLOduration=1.7472689529999998 podStartE2EDuration="10.614460319s" totalImagesPullingTime="8.867191366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:59.613499649 +0000 UTC m=+99.070050046" watchObservedRunningTime="2026-07-10 18:59:59.614460319 +0000 UTC m=+99.071010703"
Jul 10 18:59:59.635479 ip-10-0-131-123 kubenswrapper[2579]: I0710 18:59:59.635425    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-vxfjr" podStartSLOduration=2.583468893 podStartE2EDuration="21.63540375s" totalImagesPullingTime="19.051934857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:59:59.634113556 +0000 UTC m=+99.090663959" watchObservedRunningTime="2026-07-10 18:59:59.63540375 +0000 UTC m=+99.091954127"
Jul 10 19:00:00.584614 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:00.584574    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k5vrp" event={"ID":"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a","Type":"ContainerStarted","Data":"83175332be26e4f389e2f2cf5020f28433fc769cf1dd64f5b6b9fdede8396c81"}
Jul 10 19:00:00.585162 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:00.584637    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k5vrp" event={"ID":"d801d62b-f25d-4dc9-bd05-d04d2a83ca9a","Type":"ContainerStarted","Data":"6235bf1145a5f802ccf0ae8dd28f4ec3f52552a3ece03ecc2a441ea1e40b85fd"}
Jul 10 19:00:00.625110 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:00.623593    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k5vrp" podStartSLOduration=3.132847027 podStartE2EDuration="11.623571817s" totalImagesPullingTime="8.413906982s" totalInitContainerRuntime="76.817808ms" isStatefulPod=true podCreationTimestamp="2026-07-10 18:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:00.621429139 +0000 UTC m=+100.077979539" watchObservedRunningTime="2026-07-10 19:00:00.623571817 +0000 UTC m=+100.080122198"
Jul 10 19:00:01.479611 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:01.479528    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-575dcb8698-5sssc"
Jul 10 19:00:01.510118 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:01.510015    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:01.647134 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:01.647083    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:01.748502 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:01.748354    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:01.886623 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:01.886517    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:02.433754 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:02.433719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:03.432146 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:03.432060    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sl68j"
Jul 10 19:00:03.599108 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:03.599069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5998c559-9rkp6" event={"ID":"0bf6d276-a76d-4e98-a1df-0d0f96dfa163","Type":"ContainerStarted","Data":"e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222"}
Jul 10 19:00:03.619919 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:03.619855    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b5998c559-9rkp6" podStartSLOduration=1.678172253 podStartE2EDuration="5.619836323s" totalImagesPullingTime="3.94166407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:03.6188904 +0000 UTC m=+103.075440781" watchObservedRunningTime="2026-07-10 19:00:03.619836323 +0000 UTC m=+103.076386687"
Jul 10 19:00:03.991551 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:03.991498    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng" podUID="452f8c4a-8154-403d-a457-96cc8d4cf1d6" containerName="registry" containerID="cri-o://f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc" gracePeriod=30
Jul 10 19:00:04.283034 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.283005    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 19:00:04.386555 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.386522    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/452f8c4a-8154-403d-a457-96cc8d4cf1d6-ca-trust-extracted\") pod \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") "
Jul 10 19:00:04.386739 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.386574    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c627\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-kube-api-access-9c627\") pod \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") "
Jul 10 19:00:04.386739 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.386632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-certificates\") pod \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") "
Jul 10 19:00:04.386739 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.386685    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-bound-sa-token\") pod \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") "
Jul 10 19:00:04.386739 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.386726    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-trusted-ca\") pod \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") "
Jul 10 19:00:04.386955 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.386749    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-installation-pull-secrets\") pod \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") "
Jul 10 19:00:04.386955 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.386798    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls\") pod \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") "
Jul 10 19:00:04.386955 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.386830    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-image-registry-private-configuration\") pod \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\" (UID: \"452f8c4a-8154-403d-a457-96cc8d4cf1d6\") "
Jul 10 19:00:04.387104 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.387063    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "452f8c4a-8154-403d-a457-96cc8d4cf1d6" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:00:04.387159 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.387137    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-certificates\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:00:04.388025 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.387729    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "452f8c4a-8154-403d-a457-96cc8d4cf1d6" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:00:04.390667 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.390578    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "452f8c4a-8154-403d-a457-96cc8d4cf1d6" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:00:04.390955 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.390926    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-kube-api-access-9c627" (OuterVolumeSpecName: "kube-api-access-9c627") pod "452f8c4a-8154-403d-a457-96cc8d4cf1d6" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6"). InnerVolumeSpecName "kube-api-access-9c627". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:00:04.390955 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.390937    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "452f8c4a-8154-403d-a457-96cc8d4cf1d6" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:00:04.391128 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.390965    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "452f8c4a-8154-403d-a457-96cc8d4cf1d6" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:00:04.391128 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.391048    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "452f8c4a-8154-403d-a457-96cc8d4cf1d6" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:00:04.397134 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.397106    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452f8c4a-8154-403d-a457-96cc8d4cf1d6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "452f8c4a-8154-403d-a457-96cc8d4cf1d6" (UID: "452f8c4a-8154-403d-a457-96cc8d4cf1d6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:00:04.487975 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.487935    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-bound-sa-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:00:04.487975 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.487968    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/452f8c4a-8154-403d-a457-96cc8d4cf1d6-trusted-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:00:04.487975 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.487981    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-installation-pull-secrets\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:00:04.488462 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.487994    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-registry-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:00:04.488462 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.488007    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/452f8c4a-8154-403d-a457-96cc8d4cf1d6-image-registry-private-configuration\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:00:04.488462 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.488023    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/452f8c4a-8154-403d-a457-96cc8d4cf1d6-ca-trust-extracted\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:00:04.488462 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.488034    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c627\" (UniqueName: \"kubernetes.io/projected/452f8c4a-8154-403d-a457-96cc8d4cf1d6-kube-api-access-9c627\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:00:04.605997 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.605909    2579 generic.go:356] "Generic (PLEG): container finished" podID="452f8c4a-8154-403d-a457-96cc8d4cf1d6" containerID="f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc" exitCode=0
Jul 10 19:00:04.605997 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.605966    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng"
Jul 10 19:00:04.606277 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.605992    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng" event={"ID":"452f8c4a-8154-403d-a457-96cc8d4cf1d6","Type":"ContainerDied","Data":"f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc"}
Jul 10 19:00:04.606277 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.606080    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-547b66d8cd-mgcng" event={"ID":"452f8c4a-8154-403d-a457-96cc8d4cf1d6","Type":"ContainerDied","Data":"f89b7241ee38f2269535c598a3e128972603ec3bbf35ad7d774b54812025db3d"}
Jul 10 19:00:04.606277 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.606108    2579 scope.go:117] "RemoveContainer" containerID="f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc"
Jul 10 19:00:04.617120 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.617099    2579 scope.go:117] "RemoveContainer" containerID="f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc"
Jul 10 19:00:04.617496 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:00:04.617468    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc\": container with ID starting with f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc not found: ID does not exist" containerID="f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc"
Jul 10 19:00:04.617597 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.617507    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc"} err="failed to get container status \"f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc\": rpc error: code = NotFound desc = could not find container \"f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc\": container with ID starting with f4322d0fbf2be4c2b6e9c54ef0733fb5f709fa14e78f6f9a24033fc0852818bc not found: ID does not exist"
Jul 10 19:00:04.629728 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.629696    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-547b66d8cd-mgcng"]
Jul 10 19:00:04.634242 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:04.634212    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-547b66d8cd-mgcng"]
Jul 10 19:00:05.123322 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:05.123281    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="452f8c4a-8154-403d-a457-96cc8d4cf1d6" path="/var/lib/kubelet/pods/452f8c4a-8154-403d-a457-96cc8d4cf1d6/volumes"
Jul 10 19:00:06.877818 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:06.877759    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:06.974524 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:06.974490    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:08.173014 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:08.172986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:08.274503 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:08.274466    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:08.707447 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:08.707409    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 19:00:08.707646 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:08.707476    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 19:00:08.712105 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:08.712080    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 19:00:09.631396 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:09.631354    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 19:00:10.441795 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:10.441761    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:10.541998 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:10.541966    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:10.644242 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:10.644212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:11.511121 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:11.511084    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:11.600582 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:11.600551    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:12.596665 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:12.596624    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:12.703460 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:12.703423    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:13.397920 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:13.397874    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:13.506008 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:13.505972    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:14.168051 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:14.168005    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:14.235348 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:14.235315    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:14.646524 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:14.646493    2579 generic.go:356] "Generic (PLEG): container finished" podID="58cdd02c-fa04-4d34-9e93-ef6619456821" containerID="4faaeb7a05aefb4b45b9d8a68192762a60bb6c7b8a7fa6b53df284dd455dad31" exitCode=0
Jul 10 19:00:14.646703 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:14.646565    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-87c77" event={"ID":"58cdd02c-fa04-4d34-9e93-ef6619456821","Type":"ContainerDied","Data":"4faaeb7a05aefb4b45b9d8a68192762a60bb6c7b8a7fa6b53df284dd455dad31"}
Jul 10 19:00:14.646905 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:14.646893    2579 scope.go:117] "RemoveContainer" containerID="4faaeb7a05aefb4b45b9d8a68192762a60bb6c7b8a7fa6b53df284dd455dad31"
Jul 10 19:00:14.984001 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:14.983920    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:15.050231 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:15.050197    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:15.602264 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:15.602231    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b8f9f9c6d-5bl7h_fe60350d-1703-4cd7-b18a-deca0ffe4d54/router/0.log"
Jul 10 19:00:15.609564 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:15.609540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nb85_10f54178-163e-47c9-8a23-586879ffa3ba/serve-healthcheck-canary/0.log"
Jul 10 19:00:15.652148 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:15.652112    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-87c77" event={"ID":"58cdd02c-fa04-4d34-9e93-ef6619456821","Type":"ContainerStarted","Data":"9712dd654a3933836769d5b92f4af81a7d63afeb7efb808ac5f797abed5b47e9"}
Jul 10 19:00:20.167972 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:20.167938    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:20.268553 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:20.268518    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:20.333329 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:20.333295    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:30.816924 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:30.816887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 19:00:30.819340 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:30.819302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03c8f640-6992-4fac-8c1d-802baf0a69d4-metrics-certs\") pod \"network-metrics-daemon-w6cw9\" (UID: \"03c8f640-6992-4fac-8c1d-802baf0a69d4\") " pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 19:00:31.031822 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:31.031790    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xvd26\""
Jul 10 19:00:31.039300 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:31.039280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w6cw9"
Jul 10 19:00:31.195219 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:31.195192    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w6cw9"]
Jul 10 19:00:31.197458 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:00:31.197430    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c8f640_6992_4fac_8c1d_802baf0a69d4.slice/crio-8a8e804ac52c4535c0ebc10c31c2ae6f80679779aa695aa1c6e857808cb89c3f WatchSource:0}: Error finding container 8a8e804ac52c4535c0ebc10c31c2ae6f80679779aa695aa1c6e857808cb89c3f: Status 404 returned error can't find the container with id 8a8e804ac52c4535c0ebc10c31c2ae6f80679779aa695aa1c6e857808cb89c3f
Jul 10 19:00:31.713768 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:31.713732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w6cw9" event={"ID":"03c8f640-6992-4fac-8c1d-802baf0a69d4","Type":"ContainerStarted","Data":"8a8e804ac52c4535c0ebc10c31c2ae6f80679779aa695aa1c6e857808cb89c3f"}
Jul 10 19:00:33.722194 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:33.722157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w6cw9" event={"ID":"03c8f640-6992-4fac-8c1d-802baf0a69d4","Type":"ContainerStarted","Data":"3d1fcaee8d67bf3d89c9fd6581ea86e078ef23e98c72802bba57b8f5f9b047ed"}
Jul 10 19:00:33.722663 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:33.722208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w6cw9" event={"ID":"03c8f640-6992-4fac-8c1d-802baf0a69d4","Type":"ContainerStarted","Data":"548ca9d8193dcd6247ead66cec86cf57f0d900ec0b1e05510a568a77bc38e08f"}
Jul 10 19:00:33.739957 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:33.739909    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w6cw9" podStartSLOduration=131.246513078 podStartE2EDuration="2m12.739894429s" totalImagesPullingTime="1.493381351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:00:33.738163788 +0000 UTC m=+133.194714176" watchObservedRunningTime="2026-07-10 19:00:33.739894429 +0000 UTC m=+133.196444806"
Jul 10 19:00:33.836194 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:33.836163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:33.905441 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:33.905410    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:40.380706 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:40.380671    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:00:40.447022 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:00:40.446978    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:08.875686 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:08.875648    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:09.652157 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:09.652116    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:18.265673 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.265592    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77457d7b9f-bftnh"]
Jul 10 19:01:18.266695 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.266666    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452f8c4a-8154-403d-a457-96cc8d4cf1d6" containerName="registry"
Jul 10 19:01:18.266695 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.266696    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="452f8c4a-8154-403d-a457-96cc8d4cf1d6" containerName="registry"
Jul 10 19:01:18.266892 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.266795    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="452f8c4a-8154-403d-a457-96cc8d4cf1d6" containerName="registry"
Jul 10 19:01:18.269971 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.269951    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.280944 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.280921    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77457d7b9f-bftnh"]
Jul 10 19:01:18.326216 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.326183    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:18.390589 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.390546    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:18.404493 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.404458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-config\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.404637 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.404518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-service-ca\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.404637 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.404536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-oauth-serving-cert\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.404637 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.404601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvk9t\" (UniqueName: \"kubernetes.io/projected/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-kube-api-access-xvk9t\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.404753 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.404658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-oauth-config\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.404753 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.404710    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-serving-cert\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.404827 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.404770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-trusted-ca-bundle\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.506063 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.506025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-trusted-ca-bundle\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.506245 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.506075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-config\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.506245 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.506118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-service-ca\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.506245 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.506137    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-oauth-serving-cert\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.506245 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.506163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvk9t\" (UniqueName: \"kubernetes.io/projected/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-kube-api-access-xvk9t\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.506245 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.506189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-oauth-config\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.506245 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.506215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-serving-cert\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.506951 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.506920    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-oauth-serving-cert\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.507054 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.506932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-config\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.507054 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.506932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-service-ca\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.507054 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.507009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-trusted-ca-bundle\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.508620 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.508601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-oauth-config\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.508710 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.508699    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-serving-cert\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.514467 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.514448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvk9t\" (UniqueName: \"kubernetes.io/projected/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-kube-api-access-xvk9t\") pod \"console-77457d7b9f-bftnh\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") " pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.580294 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.580226    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:18.605951 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.605928    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:18.705153 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.705118    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:18.710633 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.710611    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77457d7b9f-bftnh"]
Jul 10 19:01:18.713275 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:01:18.713251    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025c88b4_b8c4_4f65_a2fb_17f08dc8d130.slice/crio-83b56b15bf62928ae2466565067cdaf4c1dcbab544472f359ef02746e7edeac3 WatchSource:0}: Error finding container 83b56b15bf62928ae2466565067cdaf4c1dcbab544472f359ef02746e7edeac3: Status 404 returned error can't find the container with id 83b56b15bf62928ae2466565067cdaf4c1dcbab544472f359ef02746e7edeac3
Jul 10 19:01:18.886358 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.886326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77457d7b9f-bftnh" event={"ID":"025c88b4-b8c4-4f65-a2fb-17f08dc8d130","Type":"ContainerStarted","Data":"b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f"}
Jul 10 19:01:18.886531 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.886398    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77457d7b9f-bftnh" event={"ID":"025c88b4-b8c4-4f65-a2fb-17f08dc8d130","Type":"ContainerStarted","Data":"83b56b15bf62928ae2466565067cdaf4c1dcbab544472f359ef02746e7edeac3"}
Jul 10 19:01:18.905274 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:18.905224    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77457d7b9f-bftnh" podStartSLOduration=0.905207068 podStartE2EDuration="905.207068ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:01:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:01:18.903989728 +0000 UTC m=+178.360540105" watchObservedRunningTime="2026-07-10 19:01:18.905207068 +0000 UTC m=+178.361757445"
Jul 10 19:01:19.204524 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:19.204417    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:19.305719 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:19.305684    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:22.240297 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:22.240267    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:28.581353 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:28.581321    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:28.581758 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:28.581395    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:28.586184 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:28.586152    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:28.925572 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:28.925539    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:01:28.970839 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:28.970799    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5998c559-9rkp6"]
Jul 10 19:01:29.069268 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:29.069236    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:29.128130 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:29.128098    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:45.711454 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:45.711419    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:45.764115 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:45.764084    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:01:53.997627 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:53.997564    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b5998c559-9rkp6" podUID="0bf6d276-a76d-4e98-a1df-0d0f96dfa163" containerName="console" containerID="cri-o://e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222" gracePeriod=15
Jul 10 19:01:54.239827 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.239800    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 19:01:54.298626 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.298539    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-trusted-ca-bundle\") pod \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") "
Jul 10 19:01:54.298626 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.298590    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdjwh\" (UniqueName: \"kubernetes.io/projected/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-kube-api-access-fdjwh\") pod \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") "
Jul 10 19:01:54.298845 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.298628    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-serving-cert\") pod \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") "
Jul 10 19:01:54.298845 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.298663    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-oauth-config\") pod \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") "
Jul 10 19:01:54.298845 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.298715    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-oauth-serving-cert\") pod \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") "
Jul 10 19:01:54.298845 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.298751    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-service-ca\") pod \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") "
Jul 10 19:01:54.298845 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.298772    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-config\") pod \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\" (UID: \"0bf6d276-a76d-4e98-a1df-0d0f96dfa163\") "
Jul 10 19:01:54.299082 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.298947    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0bf6d276-a76d-4e98-a1df-0d0f96dfa163" (UID: "0bf6d276-a76d-4e98-a1df-0d0f96dfa163"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:01:54.299252 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.299224    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-service-ca" (OuterVolumeSpecName: "service-ca") pod "0bf6d276-a76d-4e98-a1df-0d0f96dfa163" (UID: "0bf6d276-a76d-4e98-a1df-0d0f96dfa163"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:01:54.299252 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.299239    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0bf6d276-a76d-4e98-a1df-0d0f96dfa163" (UID: "0bf6d276-a76d-4e98-a1df-0d0f96dfa163"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:01:54.299439 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.299349    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-config" (OuterVolumeSpecName: "console-config") pod "0bf6d276-a76d-4e98-a1df-0d0f96dfa163" (UID: "0bf6d276-a76d-4e98-a1df-0d0f96dfa163"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:01:54.300988 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.300959    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0bf6d276-a76d-4e98-a1df-0d0f96dfa163" (UID: "0bf6d276-a76d-4e98-a1df-0d0f96dfa163"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:01:54.301255 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.301233    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0bf6d276-a76d-4e98-a1df-0d0f96dfa163" (UID: "0bf6d276-a76d-4e98-a1df-0d0f96dfa163"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:01:54.301255 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.301245    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-kube-api-access-fdjwh" (OuterVolumeSpecName: "kube-api-access-fdjwh") pod "0bf6d276-a76d-4e98-a1df-0d0f96dfa163" (UID: "0bf6d276-a76d-4e98-a1df-0d0f96dfa163"). InnerVolumeSpecName "kube-api-access-fdjwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:01:54.400181 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.400149    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:01:54.400181 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.400177    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-config\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:01:54.400181 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.400185    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-trusted-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:01:54.400562 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.400194    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdjwh\" (UniqueName: \"kubernetes.io/projected/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-kube-api-access-fdjwh\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:01:54.400562 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.400203    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-serving-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:01:54.400562 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.400211    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-console-oauth-config\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:01:54.400562 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:54.400219    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bf6d276-a76d-4e98-a1df-0d0f96dfa163-oauth-serving-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:01:55.020055 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:55.020018    2579 generic.go:356] "Generic (PLEG): container finished" podID="0bf6d276-a76d-4e98-a1df-0d0f96dfa163" containerID="e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222" exitCode=0
Jul 10 19:01:55.020477 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:55.020079    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5998c559-9rkp6"
Jul 10 19:01:55.020477 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:55.020083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5998c559-9rkp6" event={"ID":"0bf6d276-a76d-4e98-a1df-0d0f96dfa163","Type":"ContainerDied","Data":"e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222"}
Jul 10 19:01:55.020477 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:55.020223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5998c559-9rkp6" event={"ID":"0bf6d276-a76d-4e98-a1df-0d0f96dfa163","Type":"ContainerDied","Data":"44fea8658802538786b45e4076ac97b66e9626a5ea1f32d060b4fca875e3b7b9"}
Jul 10 19:01:55.020477 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:55.020248    2579 scope.go:117] "RemoveContainer" containerID="e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222"
Jul 10 19:01:55.028643 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:55.028625    2579 scope.go:117] "RemoveContainer" containerID="e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222"
Jul 10 19:01:55.028928 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:01:55.028910    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222\": container with ID starting with e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222 not found: ID does not exist" containerID="e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222"
Jul 10 19:01:55.028975 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:55.028938    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222"} err="failed to get container status \"e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222\": rpc error: code = NotFound desc = could not find container \"e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222\": container with ID starting with e5221f3f55a0df5449045d77c0d3c72266015fcdc0f1b96fcef130f50e3bd222 not found: ID does not exist"
Jul 10 19:01:55.040458 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:55.040431    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5998c559-9rkp6"]
Jul 10 19:01:55.043845 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:55.043822    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b5998c559-9rkp6"]
Jul 10 19:01:55.121861 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:01:55.121831    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bf6d276-a76d-4e98-a1df-0d0f96dfa163" path="/var/lib/kubelet/pods/0bf6d276-a76d-4e98-a1df-0d0f96dfa163/volumes"
Jul 10 19:02:24.152944 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:24.152908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:24.217105 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:24.217076    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:32.700338 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:32.700298    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:33.450780 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.450747    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-688cd655c9-5txf5"]
Jul 10 19:02:33.451152 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.451136    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bf6d276-a76d-4e98-a1df-0d0f96dfa163" containerName="console"
Jul 10 19:02:33.451198 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.451156    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bf6d276-a76d-4e98-a1df-0d0f96dfa163" containerName="console"
Jul 10 19:02:33.451243 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.451233    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bf6d276-a76d-4e98-a1df-0d0f96dfa163" containerName="console"
Jul 10 19:02:33.455682 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.455658    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.473987 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.473965    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688cd655c9-5txf5"]
Jul 10 19:02:33.526312 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.526283    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:33.598340 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.598306    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:33.616503 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.616471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-service-ca\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.616503 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.616505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-serving-cert\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.616715 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.616536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-oauth-serving-cert\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.616715 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.616630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-config\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.616715 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.616693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcs5k\" (UniqueName: \"kubernetes.io/projected/14f6adb7-e4b5-4baa-ae0e-3b4390254053-kube-api-access-pcs5k\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.616860 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.616750    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-trusted-ca-bundle\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.616860 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.616791    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-oauth-config\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.695322 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.695284    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:33.717501 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.717438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcs5k\" (UniqueName: \"kubernetes.io/projected/14f6adb7-e4b5-4baa-ae0e-3b4390254053-kube-api-access-pcs5k\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.717501 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.717484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-trusted-ca-bundle\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.717938 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.717503    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-oauth-config\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.717938 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.717528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-service-ca\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.717938 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.717547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-serving-cert\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.717938 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.717570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-oauth-serving-cert\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.717938 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.717601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-config\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.718422 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.718399    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-oauth-serving-cert\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.718513 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.718424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-service-ca\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.718513 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.718432    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-config\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.718747 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.718726    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-trusted-ca-bundle\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.720008 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.719985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-oauth-config\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.720093 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.720075    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-serving-cert\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.725911 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.725887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcs5k\" (UniqueName: \"kubernetes.io/projected/14f6adb7-e4b5-4baa-ae0e-3b4390254053-kube-api-access-pcs5k\") pod \"console-688cd655c9-5txf5\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") " pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.766769 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.766727    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:33.894428 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:33.894396    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688cd655c9-5txf5"]
Jul 10 19:02:33.897769 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:02:33.897730    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f6adb7_e4b5_4baa_ae0e_3b4390254053.slice/crio-0182891b8f2e7c6cf7829006e2a4953c383056885b1f0be61ebc0518046bfca2 WatchSource:0}: Error finding container 0182891b8f2e7c6cf7829006e2a4953c383056885b1f0be61ebc0518046bfca2: Status 404 returned error can't find the container with id 0182891b8f2e7c6cf7829006e2a4953c383056885b1f0be61ebc0518046bfca2
Jul 10 19:02:34.165329 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:34.165296    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cd655c9-5txf5" event={"ID":"14f6adb7-e4b5-4baa-ae0e-3b4390254053","Type":"ContainerStarted","Data":"996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c"}
Jul 10 19:02:34.165533 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:34.165393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cd655c9-5txf5" event={"ID":"14f6adb7-e4b5-4baa-ae0e-3b4390254053","Type":"ContainerStarted","Data":"0182891b8f2e7c6cf7829006e2a4953c383056885b1f0be61ebc0518046bfca2"}
Jul 10 19:02:34.185765 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:34.185707    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-688cd655c9-5txf5" podStartSLOduration=1.18569414 podStartE2EDuration="1.18569414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:02:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:02:34.184336126 +0000 UTC m=+253.640886504" watchObservedRunningTime="2026-07-10 19:02:34.18569414 +0000 UTC m=+253.642244518"
Jul 10 19:02:34.465437 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:34.465300    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:34.521114 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:34.521084    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:36.203855 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:36.203798    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:36.307661 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:36.307623    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:40.385799 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:40.385727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:40.485630 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:40.485597    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:40.544356 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:40.544322    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:43.767693 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:43.767605    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:43.767693 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:43.767687    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:43.772461 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:43.772440    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:44.205327 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:44.205298    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:02:44.262486 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:44.262452    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77457d7b9f-bftnh"]
Jul 10 19:02:44.374446 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:44.374392    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:44.475466 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:44.475358    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:02:44.531931 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:02:44.531894    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:03:09.284905 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.284844    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77457d7b9f-bftnh" podUID="025c88b4-b8c4-4f65-a2fb-17f08dc8d130" containerName="console" containerID="cri-o://b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f" gracePeriod=15
Jul 10 19:03:09.524338 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.524314    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:03:09.606810 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.606736    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-trusted-ca-bundle\") pod \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") "
Jul 10 19:03:09.606810 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.606768    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-oauth-config\") pod \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") "
Jul 10 19:03:09.606810 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.606813    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-service-ca\") pod \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") "
Jul 10 19:03:09.607082 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.606955    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-config\") pod \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") "
Jul 10 19:03:09.607082 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.607003    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvk9t\" (UniqueName: \"kubernetes.io/projected/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-kube-api-access-xvk9t\") pod \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") "
Jul 10 19:03:09.607082 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.607044    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-oauth-serving-cert\") pod \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") "
Jul 10 19:03:09.607082 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.607073    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-serving-cert\") pod \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\" (UID: \"025c88b4-b8c4-4f65-a2fb-17f08dc8d130\") "
Jul 10 19:03:09.607281 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.607248    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "025c88b4-b8c4-4f65-a2fb-17f08dc8d130" (UID: "025c88b4-b8c4-4f65-a2fb-17f08dc8d130"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:03:09.607281 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.607256    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-service-ca" (OuterVolumeSpecName: "service-ca") pod "025c88b4-b8c4-4f65-a2fb-17f08dc8d130" (UID: "025c88b4-b8c4-4f65-a2fb-17f08dc8d130"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:03:09.607399 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.607335    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-config" (OuterVolumeSpecName: "console-config") pod "025c88b4-b8c4-4f65-a2fb-17f08dc8d130" (UID: "025c88b4-b8c4-4f65-a2fb-17f08dc8d130"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:03:09.607399 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.607357    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:03:09.607507 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.607408    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-trusted-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:03:09.607560 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.607537    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "025c88b4-b8c4-4f65-a2fb-17f08dc8d130" (UID: "025c88b4-b8c4-4f65-a2fb-17f08dc8d130"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:03:09.609009 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.608986    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "025c88b4-b8c4-4f65-a2fb-17f08dc8d130" (UID: "025c88b4-b8c4-4f65-a2fb-17f08dc8d130"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:03:09.609009 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.608996    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-kube-api-access-xvk9t" (OuterVolumeSpecName: "kube-api-access-xvk9t") pod "025c88b4-b8c4-4f65-a2fb-17f08dc8d130" (UID: "025c88b4-b8c4-4f65-a2fb-17f08dc8d130"). InnerVolumeSpecName "kube-api-access-xvk9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:03:09.609140 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.609086    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "025c88b4-b8c4-4f65-a2fb-17f08dc8d130" (UID: "025c88b4-b8c4-4f65-a2fb-17f08dc8d130"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:03:09.708665 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.708628    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-config\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:03:09.708665 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.708658    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvk9t\" (UniqueName: \"kubernetes.io/projected/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-kube-api-access-xvk9t\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:03:09.708665 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.708669    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-oauth-serving-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:03:09.708882 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.708677    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-serving-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:03:09.708882 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:09.708686    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/025c88b4-b8c4-4f65-a2fb-17f08dc8d130-console-oauth-config\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:03:10.294982 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:10.294950    2579 generic.go:356] "Generic (PLEG): container finished" podID="025c88b4-b8c4-4f65-a2fb-17f08dc8d130" containerID="b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f" exitCode=0
Jul 10 19:03:10.295417 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:10.294988    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77457d7b9f-bftnh"
Jul 10 19:03:10.295417 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:10.295025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77457d7b9f-bftnh" event={"ID":"025c88b4-b8c4-4f65-a2fb-17f08dc8d130","Type":"ContainerDied","Data":"b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f"}
Jul 10 19:03:10.295417 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:10.295089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77457d7b9f-bftnh" event={"ID":"025c88b4-b8c4-4f65-a2fb-17f08dc8d130","Type":"ContainerDied","Data":"83b56b15bf62928ae2466565067cdaf4c1dcbab544472f359ef02746e7edeac3"}
Jul 10 19:03:10.295417 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:10.295120    2579 scope.go:117] "RemoveContainer" containerID="b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f"
Jul 10 19:03:10.303013 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:10.302993    2579 scope.go:117] "RemoveContainer" containerID="b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f"
Jul 10 19:03:10.303267 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:03:10.303243    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f\": container with ID starting with b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f not found: ID does not exist" containerID="b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f"
Jul 10 19:03:10.303398 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:10.303274    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f"} err="failed to get container status \"b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f\": rpc error: code = NotFound desc = could not find container \"b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f\": container with ID starting with b4a18dbdb8145043dc30440f7b7b5d0a70bcf3910d9983e0a4b411df8594ad2f not found: ID does not exist"
Jul 10 19:03:10.316015 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:10.315989    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77457d7b9f-bftnh"]
Jul 10 19:03:10.321300 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:10.321274    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77457d7b9f-bftnh"]
Jul 10 19:03:11.121057 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:11.121027    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="025c88b4-b8c4-4f65-a2fb-17f08dc8d130" path="/var/lib/kubelet/pods/025c88b4-b8c4-4f65-a2fb-17f08dc8d130/volumes"
Jul 10 19:03:20.882538 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:20.882512    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:03:20.883936 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:20.883913    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:03:20.886918 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:20.886897    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:03:20.888358 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:20.888338    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:03:20.892592 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:20.892574    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 19:03:45.617610 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:45.617576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:03:46.867794 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:46.867759    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:03:47.426511 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.426478    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"]
Jul 10 19:03:47.426760 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.426745    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025c88b4-b8c4-4f65-a2fb-17f08dc8d130" containerName="console"
Jul 10 19:03:47.426760 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.426760    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="025c88b4-b8c4-4f65-a2fb-17f08dc8d130" containerName="console"
Jul 10 19:03:47.426875 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.426833    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="025c88b4-b8c4-4f65-a2fb-17f08dc8d130" containerName="console"
Jul 10 19:03:47.429731 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.429713    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:03:47.432218 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.432198    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 19:03:47.432450 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.432434    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pgwww\""
Jul 10 19:03:47.433306 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.433291    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 19:03:47.439654 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.439633    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"]
Jul 10 19:03:47.503487 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.503455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:03:47.503641 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.503517    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:03:47.503641 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.503540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjmmw\" (UniqueName: \"kubernetes.io/projected/5561af50-6bf8-456e-84bc-a00e3148cbab-kube-api-access-hjmmw\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:03:47.603897 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.603863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:03:47.604036 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.603906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjmmw\" (UniqueName: \"kubernetes.io/projected/5561af50-6bf8-456e-84bc-a00e3148cbab-kube-api-access-hjmmw\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:03:47.604036 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.603947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:03:47.604299 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.604279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:03:47.604362 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.604307    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:03:47.612570 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.612546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjmmw\" (UniqueName: \"kubernetes.io/projected/5561af50-6bf8-456e-84bc-a00e3148cbab-kube-api-access-hjmmw\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:03:47.738830 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.738748    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:03:47.864956 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.864923    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"]
Jul 10 19:03:47.868593 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:03:47.868566    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5561af50_6bf8_456e_84bc_a00e3148cbab.slice/crio-414a82075282a1d28a28c8a1dfafb0f2f0742199510a566570fad7b16ac8c4ae WatchSource:0}: Error finding container 414a82075282a1d28a28c8a1dfafb0f2f0742199510a566570fad7b16ac8c4ae: Status 404 returned error can't find the container with id 414a82075282a1d28a28c8a1dfafb0f2f0742199510a566570fad7b16ac8c4ae
Jul 10 19:03:47.870534 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:47.870520    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 19:03:48.432838 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:48.432799    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk" event={"ID":"5561af50-6bf8-456e-84bc-a00e3148cbab","Type":"ContainerStarted","Data":"414a82075282a1d28a28c8a1dfafb0f2f0742199510a566570fad7b16ac8c4ae"}
Jul 10 19:03:53.454320 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:53.454282    2579 generic.go:356] "Generic (PLEG): container finished" podID="5561af50-6bf8-456e-84bc-a00e3148cbab" containerID="75ac2ff3cfb601544d963ced821a20db1b9936b34f5070d64ddd23bd88e2b94a" exitCode=0
Jul 10 19:03:53.454738 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:53.454391    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk" event={"ID":"5561af50-6bf8-456e-84bc-a00e3148cbab","Type":"ContainerDied","Data":"75ac2ff3cfb601544d963ced821a20db1b9936b34f5070d64ddd23bd88e2b94a"}
Jul 10 19:03:55.467540 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:55.467495    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk" event={"ID":"5561af50-6bf8-456e-84bc-a00e3148cbab","Type":"ContainerStarted","Data":"afe62d3d141059e106fc15bc483328b6a5e3110643ec414e2ce1dfa4ff05dfd1"}
Jul 10 19:03:56.472748 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:56.472711    2579 generic.go:356] "Generic (PLEG): container finished" podID="5561af50-6bf8-456e-84bc-a00e3148cbab" containerID="afe62d3d141059e106fc15bc483328b6a5e3110643ec414e2ce1dfa4ff05dfd1" exitCode=0
Jul 10 19:03:56.473226 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:03:56.472780    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk" event={"ID":"5561af50-6bf8-456e-84bc-a00e3148cbab","Type":"ContainerDied","Data":"afe62d3d141059e106fc15bc483328b6a5e3110643ec414e2ce1dfa4ff05dfd1"}
Jul 10 19:04:02.498651 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:02.498555    2579 generic.go:356] "Generic (PLEG): container finished" podID="5561af50-6bf8-456e-84bc-a00e3148cbab" containerID="c21a0fa08c27a67785e7b19c71aada9962569c2962fe41ca0155841f54939111" exitCode=0
Jul 10 19:04:02.498651 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:02.498633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk" event={"ID":"5561af50-6bf8-456e-84bc-a00e3148cbab","Type":"ContainerDied","Data":"c21a0fa08c27a67785e7b19c71aada9962569c2962fe41ca0155841f54939111"}
Jul 10 19:04:03.623547 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:03.623523    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:04:03.731932 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:03.731894    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-bundle\") pod \"5561af50-6bf8-456e-84bc-a00e3148cbab\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") "
Jul 10 19:04:03.732099 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:03.731952    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjmmw\" (UniqueName: \"kubernetes.io/projected/5561af50-6bf8-456e-84bc-a00e3148cbab-kube-api-access-hjmmw\") pod \"5561af50-6bf8-456e-84bc-a00e3148cbab\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") "
Jul 10 19:04:03.732099 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:03.731986    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-util\") pod \"5561af50-6bf8-456e-84bc-a00e3148cbab\" (UID: \"5561af50-6bf8-456e-84bc-a00e3148cbab\") "
Jul 10 19:04:03.732762 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:03.732733    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-bundle" (OuterVolumeSpecName: "bundle") pod "5561af50-6bf8-456e-84bc-a00e3148cbab" (UID: "5561af50-6bf8-456e-84bc-a00e3148cbab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:04:03.734082 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:03.734059    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5561af50-6bf8-456e-84bc-a00e3148cbab-kube-api-access-hjmmw" (OuterVolumeSpecName: "kube-api-access-hjmmw") pod "5561af50-6bf8-456e-84bc-a00e3148cbab" (UID: "5561af50-6bf8-456e-84bc-a00e3148cbab"). InnerVolumeSpecName "kube-api-access-hjmmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:04:03.736771 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:03.736745    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-util" (OuterVolumeSpecName: "util") pod "5561af50-6bf8-456e-84bc-a00e3148cbab" (UID: "5561af50-6bf8-456e-84bc-a00e3148cbab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 19:04:03.832636 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:03.832553    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjmmw\" (UniqueName: \"kubernetes.io/projected/5561af50-6bf8-456e-84bc-a00e3148cbab-kube-api-access-hjmmw\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:04:03.832636 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:03.832580    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-util\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:04:03.832636 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:03.832590    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5561af50-6bf8-456e-84bc-a00e3148cbab-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:04:04.508210 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:04.508182    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk"
Jul 10 19:04:04.508403 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:04.508179    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589vmprk" event={"ID":"5561af50-6bf8-456e-84bc-a00e3148cbab","Type":"ContainerDied","Data":"414a82075282a1d28a28c8a1dfafb0f2f0742199510a566570fad7b16ac8c4ae"}
Jul 10 19:04:04.508403 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:04.508311    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="414a82075282a1d28a28c8a1dfafb0f2f0742199510a566570fad7b16ac8c4ae"
Jul 10 19:04:08.742111 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:08.742072    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:08.885991 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:08.885958    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:10.538811 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.538783    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"]
Jul 10 19:04:10.539185 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.539055    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5561af50-6bf8-456e-84bc-a00e3148cbab" containerName="extract"
Jul 10 19:04:10.539185 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.539064    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5561af50-6bf8-456e-84bc-a00e3148cbab" containerName="extract"
Jul 10 19:04:10.539185 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.539076    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5561af50-6bf8-456e-84bc-a00e3148cbab" containerName="util"
Jul 10 19:04:10.539185 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.539081    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5561af50-6bf8-456e-84bc-a00e3148cbab" containerName="util"
Jul 10 19:04:10.539185 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.539091    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5561af50-6bf8-456e-84bc-a00e3148cbab" containerName="pull"
Jul 10 19:04:10.539185 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.539096    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5561af50-6bf8-456e-84bc-a00e3148cbab" containerName="pull"
Jul 10 19:04:10.539185 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.539146    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5561af50-6bf8-456e-84bc-a00e3148cbab" containerName="extract"
Jul 10 19:04:10.576016 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.575985    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"]
Jul 10 19:04:10.576173 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.576095    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"
Jul 10 19:04:10.578835 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.578814    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 10 19:04:10.579113 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.579097    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 10 19:04:10.579388 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.579357    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-5psbq\""
Jul 10 19:04:10.579456 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.579427    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 10 19:04:10.686415 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.686358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/06ee4569-63c1-43a3-ad5c-829ac3cd82dd-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l79dt\" (UID: \"06ee4569-63c1-43a3-ad5c-829ac3cd82dd\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"
Jul 10 19:04:10.686415 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.686417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2thj\" (UniqueName: \"kubernetes.io/projected/06ee4569-63c1-43a3-ad5c-829ac3cd82dd-kube-api-access-b2thj\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l79dt\" (UID: \"06ee4569-63c1-43a3-ad5c-829ac3cd82dd\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"
Jul 10 19:04:10.787346 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.787309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/06ee4569-63c1-43a3-ad5c-829ac3cd82dd-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l79dt\" (UID: \"06ee4569-63c1-43a3-ad5c-829ac3cd82dd\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"
Jul 10 19:04:10.787346 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.787348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2thj\" (UniqueName: \"kubernetes.io/projected/06ee4569-63c1-43a3-ad5c-829ac3cd82dd-kube-api-access-b2thj\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l79dt\" (UID: \"06ee4569-63c1-43a3-ad5c-829ac3cd82dd\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"
Jul 10 19:04:10.789718 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.789667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/06ee4569-63c1-43a3-ad5c-829ac3cd82dd-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l79dt\" (UID: \"06ee4569-63c1-43a3-ad5c-829ac3cd82dd\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"
Jul 10 19:04:10.806010 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.805979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2thj\" (UniqueName: \"kubernetes.io/projected/06ee4569-63c1-43a3-ad5c-829ac3cd82dd-kube-api-access-b2thj\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-l79dt\" (UID: \"06ee4569-63c1-43a3-ad5c-829ac3cd82dd\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"
Jul 10 19:04:10.886024 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:10.885987    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"
Jul 10 19:04:11.049208 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:11.049130    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"]
Jul 10 19:04:11.052401 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:04:11.052363    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ee4569_63c1_43a3_ad5c_829ac3cd82dd.slice/crio-7129c5f52cfb6a8ea85242323dbb5539a1516094651e8e5f78fd28cdc841bff8 WatchSource:0}: Error finding container 7129c5f52cfb6a8ea85242323dbb5539a1516094651e8e5f78fd28cdc841bff8: Status 404 returned error can't find the container with id 7129c5f52cfb6a8ea85242323dbb5539a1516094651e8e5f78fd28cdc841bff8
Jul 10 19:04:11.542448 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:11.542406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt" event={"ID":"06ee4569-63c1-43a3-ad5c-829ac3cd82dd","Type":"ContainerStarted","Data":"7129c5f52cfb6a8ea85242323dbb5539a1516094651e8e5f78fd28cdc841bff8"}
Jul 10 19:04:13.552914 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:13.552875    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt" event={"ID":"06ee4569-63c1-43a3-ad5c-829ac3cd82dd","Type":"ContainerStarted","Data":"2ddb249b24759f353d0855059c0b5d53174f7b961c70ce3c0befd4ab72f929c6"}
Jul 10 19:04:13.553292 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:13.552973    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"
Jul 10 19:04:13.579868 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:13.579813    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt" podStartSLOduration=1.173082266 podStartE2EDuration="3.579797528s" totalImagesPullingTime="2.406715262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:13.57794949 +0000 UTC m=+353.034499892" watchObservedRunningTime="2026-07-10 19:04:13.579797528 +0000 UTC m=+353.036347905"
Jul 10 19:04:13.929689 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:13.929655    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:14.298833 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.298742    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:14.338809 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.338776    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-lvdvf"]
Jul 10 19:04:14.341787 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.341769    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:14.346318 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.346296    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 10 19:04:14.347388 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.347338    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-r7pfd\""
Jul 10 19:04:14.350244 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.350226    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 10 19:04:14.373052 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.373029    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-lvdvf"]
Jul 10 19:04:14.418594 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.418559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2f665490-3f1d-4519-85a9-a669b4c240fa-cabundle0\") pod \"keda-operator-68bff59c-lvdvf\" (UID: \"2f665490-3f1d-4519-85a9-a669b4c240fa\") " pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:14.418594 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.418600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ff9n\" (UniqueName: \"kubernetes.io/projected/2f665490-3f1d-4519-85a9-a669b4c240fa-kube-api-access-7ff9n\") pod \"keda-operator-68bff59c-lvdvf\" (UID: \"2f665490-3f1d-4519-85a9-a669b4c240fa\") " pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:14.418812 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.418675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2f665490-3f1d-4519-85a9-a669b4c240fa-certificates\") pod \"keda-operator-68bff59c-lvdvf\" (UID: \"2f665490-3f1d-4519-85a9-a669b4c240fa\") " pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:14.519499 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.519461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2f665490-3f1d-4519-85a9-a669b4c240fa-cabundle0\") pod \"keda-operator-68bff59c-lvdvf\" (UID: \"2f665490-3f1d-4519-85a9-a669b4c240fa\") " pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:14.519499 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.519498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ff9n\" (UniqueName: \"kubernetes.io/projected/2f665490-3f1d-4519-85a9-a669b4c240fa-kube-api-access-7ff9n\") pod \"keda-operator-68bff59c-lvdvf\" (UID: \"2f665490-3f1d-4519-85a9-a669b4c240fa\") " pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:14.519755 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.519524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2f665490-3f1d-4519-85a9-a669b4c240fa-certificates\") pod \"keda-operator-68bff59c-lvdvf\" (UID: \"2f665490-3f1d-4519-85a9-a669b4c240fa\") " pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:14.519755 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:04:14.519614    2579 secret.go:281] references non-existent secret key: ca.crt
Jul 10 19:04:14.519755 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:04:14.519626    2579 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 10 19:04:14.519755 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:04:14.519633    2579 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-lvdvf: references non-existent secret key: ca.crt
Jul 10 19:04:14.519755 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:04:14.519687    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f665490-3f1d-4519-85a9-a669b4c240fa-certificates podName:2f665490-3f1d-4519-85a9-a669b4c240fa nodeName:}" failed. No retries permitted until 2026-07-10 19:04:15.019672285 +0000 UTC m=+354.476222641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/2f665490-3f1d-4519-85a9-a669b4c240fa-certificates") pod "keda-operator-68bff59c-lvdvf" (UID: "2f665490-3f1d-4519-85a9-a669b4c240fa") : references non-existent secret key: ca.crt
Jul 10 19:04:14.520226 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.520200    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/2f665490-3f1d-4519-85a9-a669b4c240fa-cabundle0\") pod \"keda-operator-68bff59c-lvdvf\" (UID: \"2f665490-3f1d-4519-85a9-a669b4c240fa\") " pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:14.528835 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.528810    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:14.530768 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:14.530751    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ff9n\" (UniqueName: \"kubernetes.io/projected/2f665490-3f1d-4519-85a9-a669b4c240fa-kube-api-access-7ff9n\") pod \"keda-operator-68bff59c-lvdvf\" (UID: \"2f665490-3f1d-4519-85a9-a669b4c240fa\") " pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:15.024251 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.024213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2f665490-3f1d-4519-85a9-a669b4c240fa-certificates\") pod \"keda-operator-68bff59c-lvdvf\" (UID: \"2f665490-3f1d-4519-85a9-a669b4c240fa\") " pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:15.026561 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.026543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2f665490-3f1d-4519-85a9-a669b4c240fa-certificates\") pod \"keda-operator-68bff59c-lvdvf\" (UID: \"2f665490-3f1d-4519-85a9-a669b4c240fa\") " pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:15.111024 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.110991    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:15.129629 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.129599    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"]
Jul 10 19:04:15.132879 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.132857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:15.136102 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.136077    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 10 19:04:15.144719 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.144694    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"]
Jul 10 19:04:15.212361 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.212331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:15.225488 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.225460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/47c79993-bc91-4954-bff5-f118222b0f70-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-p6gwv\" (UID: \"47c79993-bc91-4954-bff5-f118222b0f70\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:15.225650 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.225565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/47c79993-bc91-4954-bff5-f118222b0f70-certificates\") pod \"keda-metrics-apiserver-559f75f947-p6gwv\" (UID: \"47c79993-bc91-4954-bff5-f118222b0f70\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:15.225650 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.225596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkbrr\" (UniqueName: \"kubernetes.io/projected/47c79993-bc91-4954-bff5-f118222b0f70-kube-api-access-dkbrr\") pod \"keda-metrics-apiserver-559f75f947-p6gwv\" (UID: \"47c79993-bc91-4954-bff5-f118222b0f70\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:15.251454 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.251432    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:15.326563 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.326531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/47c79993-bc91-4954-bff5-f118222b0f70-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-p6gwv\" (UID: \"47c79993-bc91-4954-bff5-f118222b0f70\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:15.326736 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.326584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/47c79993-bc91-4954-bff5-f118222b0f70-certificates\") pod \"keda-metrics-apiserver-559f75f947-p6gwv\" (UID: \"47c79993-bc91-4954-bff5-f118222b0f70\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:15.326736 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.326604    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkbrr\" (UniqueName: \"kubernetes.io/projected/47c79993-bc91-4954-bff5-f118222b0f70-kube-api-access-dkbrr\") pod \"keda-metrics-apiserver-559f75f947-p6gwv\" (UID: \"47c79993-bc91-4954-bff5-f118222b0f70\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:15.326971 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.326952    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/47c79993-bc91-4954-bff5-f118222b0f70-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-p6gwv\" (UID: \"47c79993-bc91-4954-bff5-f118222b0f70\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:15.329561 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.329531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/47c79993-bc91-4954-bff5-f118222b0f70-certificates\") pod \"keda-metrics-apiserver-559f75f947-p6gwv\" (UID: \"47c79993-bc91-4954-bff5-f118222b0f70\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:15.335408 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.335357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkbrr\" (UniqueName: \"kubernetes.io/projected/47c79993-bc91-4954-bff5-f118222b0f70-kube-api-access-dkbrr\") pod \"keda-metrics-apiserver-559f75f947-p6gwv\" (UID: \"47c79993-bc91-4954-bff5-f118222b0f70\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:15.363777 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.363727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:15.377271 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.377243    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-bpkkd"]
Jul 10 19:04:15.381566 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.381546    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd"
Jul 10 19:04:15.384106 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.384085    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 10 19:04:15.394444 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.394380    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-lvdvf"]
Jul 10 19:04:15.397539 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:04:15.397513    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f665490_3f1d_4519_85a9_a669b4c240fa.slice/crio-f6cbac59b9a71c6cbd3fbd1c37ccbf278010682aa60a9b6fba26395f4b98d404 WatchSource:0}: Error finding container f6cbac59b9a71c6cbd3fbd1c37ccbf278010682aa60a9b6fba26395f4b98d404: Status 404 returned error can't find the container with id f6cbac59b9a71c6cbd3fbd1c37ccbf278010682aa60a9b6fba26395f4b98d404
Jul 10 19:04:15.400464 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.399515    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-bpkkd"]
Jul 10 19:04:15.428274 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.428238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gphq6\" (UniqueName: \"kubernetes.io/projected/2b7d5c46-7162-48b1-a0c4-e99e1c865f73-kube-api-access-gphq6\") pod \"keda-admission-5fbd5c4644-bpkkd\" (UID: \"2b7d5c46-7162-48b1-a0c4-e99e1c865f73\") " pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd"
Jul 10 19:04:15.428462 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.428291    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2b7d5c46-7162-48b1-a0c4-e99e1c865f73-certificates\") pod \"keda-admission-5fbd5c4644-bpkkd\" (UID: \"2b7d5c46-7162-48b1-a0c4-e99e1c865f73\") " pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd"
Jul 10 19:04:15.445957 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.445743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:15.474703 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.474669    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:15.529266 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.529235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gphq6\" (UniqueName: \"kubernetes.io/projected/2b7d5c46-7162-48b1-a0c4-e99e1c865f73-kube-api-access-gphq6\") pod \"keda-admission-5fbd5c4644-bpkkd\" (UID: \"2b7d5c46-7162-48b1-a0c4-e99e1c865f73\") " pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd"
Jul 10 19:04:15.529459 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.529287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2b7d5c46-7162-48b1-a0c4-e99e1c865f73-certificates\") pod \"keda-admission-5fbd5c4644-bpkkd\" (UID: \"2b7d5c46-7162-48b1-a0c4-e99e1c865f73\") " pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd"
Jul 10 19:04:15.531822 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.531794    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2b7d5c46-7162-48b1-a0c4-e99e1c865f73-certificates\") pod \"keda-admission-5fbd5c4644-bpkkd\" (UID: \"2b7d5c46-7162-48b1-a0c4-e99e1c865f73\") " pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd"
Jul 10 19:04:15.538625 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.538599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gphq6\" (UniqueName: \"kubernetes.io/projected/2b7d5c46-7162-48b1-a0c4-e99e1c865f73-kube-api-access-gphq6\") pod \"keda-admission-5fbd5c4644-bpkkd\" (UID: \"2b7d5c46-7162-48b1-a0c4-e99e1c865f73\") " pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd"
Jul 10 19:04:15.565324 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.565245    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-lvdvf" event={"ID":"2f665490-3f1d-4519-85a9-a669b4c240fa","Type":"ContainerStarted","Data":"f6cbac59b9a71c6cbd3fbd1c37ccbf278010682aa60a9b6fba26395f4b98d404"}
Jul 10 19:04:15.595481 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.595445    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"]
Jul 10 19:04:15.602684 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:04:15.602651    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c79993_bc91_4954_bff5_f118222b0f70.slice/crio-a7b0b969d2ab048f61162cc2a5652a8c6f24992c31d7e333d5291e0b9a5bf7f8 WatchSource:0}: Error finding container a7b0b969d2ab048f61162cc2a5652a8c6f24992c31d7e333d5291e0b9a5bf7f8: Status 404 returned error can't find the container with id a7b0b969d2ab048f61162cc2a5652a8c6f24992c31d7e333d5291e0b9a5bf7f8
Jul 10 19:04:15.693097 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.693065    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd"
Jul 10 19:04:15.771618 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.771575    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:15.832760 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.832676    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-bpkkd"]
Jul 10 19:04:15.983641 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:15.983609    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:16.184895 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:16.184845    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:16.282626 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:16.282589    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:16.573835 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:16.573745    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv" event={"ID":"47c79993-bc91-4954-bff5-f118222b0f70","Type":"ContainerStarted","Data":"a7b0b969d2ab048f61162cc2a5652a8c6f24992c31d7e333d5291e0b9a5bf7f8"}
Jul 10 19:04:16.575176 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:16.575137    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd" event={"ID":"2b7d5c46-7162-48b1-a0c4-e99e1c865f73","Type":"ContainerStarted","Data":"9246c763e1cd2475271597ee4977ad08316760f8c1923a3af81f42a39c1d85d1"}
Jul 10 19:04:17.582434 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:17.582339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd" event={"ID":"2b7d5c46-7162-48b1-a0c4-e99e1c865f73","Type":"ContainerStarted","Data":"e441ed0d0218417b727a01f8f6fd61228ea1eb5934190a54439ff606025603ba"}
Jul 10 19:04:17.582914 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:17.582506    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd"
Jul 10 19:04:17.614440 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:17.614223    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd" podStartSLOduration=1.179052817 podStartE2EDuration="2.614203656s" totalImagesPullingTime="1.435150839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:17.61200987 +0000 UTC m=+357.068560306" watchObservedRunningTime="2026-07-10 19:04:17.614203656 +0000 UTC m=+357.070754034"
Jul 10 19:04:19.597343 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:19.597302    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-lvdvf" event={"ID":"2f665490-3f1d-4519-85a9-a669b4c240fa","Type":"ContainerStarted","Data":"9cff0c94c1ee4eb8c2be7a077deaa2b0a619e7c56c485271ba3473c0bc73d439"}
Jul 10 19:04:19.597790 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:19.597428    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:19.598937 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:19.598914    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv" event={"ID":"47c79993-bc91-4954-bff5-f118222b0f70","Type":"ContainerStarted","Data":"ad6d5bf7bc8597b2598cf0ddf149d23e4c76b20fdab244b6ad8c2d39bb05f220"}
Jul 10 19:04:19.599070 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:19.598974    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:19.651006 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:19.650957    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv" podStartSLOduration=0.900294071 podStartE2EDuration="4.650942353s" totalImagesPullingTime="3.750648282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:19.650719642 +0000 UTC m=+359.107270019" watchObservedRunningTime="2026-07-10 19:04:19.650942353 +0000 UTC m=+359.107492731"
Jul 10 19:04:19.651234 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:19.651211    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-lvdvf" podStartSLOduration=1.691947297 podStartE2EDuration="5.651205118s" totalImagesPullingTime="3.959257821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:04:19.621924745 +0000 UTC m=+359.078475156" watchObservedRunningTime="2026-07-10 19:04:19.651205118 +0000 UTC m=+359.107755495"
Jul 10 19:04:30.607814 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:30.607788    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-p6gwv"
Jul 10 19:04:34.559897 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:34.559867    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-l79dt"
Jul 10 19:04:38.591767 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:38.591736    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-bpkkd"
Jul 10 19:04:40.606119 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:40.606087    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-lvdvf"
Jul 10 19:04:44.886361 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:44.886328    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:04:47.125570 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:04:47.125540    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:05:32.390943 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.390908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:05:32.605209 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.605178    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-dmsl9"]
Jul 10 19:05:32.608584 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.608567    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-dmsl9"
Jul 10 19:05:32.613379 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.613355    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 10 19:05:32.613517 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.613360    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 10 19:05:32.613878 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.613862    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-t5zss\""
Jul 10 19:05:32.619957 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.619939    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 10 19:05:32.627694 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.627675    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-dmsl9"]
Jul 10 19:05:32.700279 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.700210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:05:32.772937 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.772903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqx88\" (UniqueName: \"kubernetes.io/projected/8a5d9c9f-1e82-458e-b43e-18d46060c768-kube-api-access-gqx88\") pod \"llmisvc-controller-manager-654c557856-dmsl9\" (UID: \"8a5d9c9f-1e82-458e-b43e-18d46060c768\") " pod="kserve/llmisvc-controller-manager-654c557856-dmsl9"
Jul 10 19:05:32.773093 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.772968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a5d9c9f-1e82-458e-b43e-18d46060c768-cert\") pod \"llmisvc-controller-manager-654c557856-dmsl9\" (UID: \"8a5d9c9f-1e82-458e-b43e-18d46060c768\") " pod="kserve/llmisvc-controller-manager-654c557856-dmsl9"
Jul 10 19:05:32.810321 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.810295    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:05:32.873460 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.873436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a5d9c9f-1e82-458e-b43e-18d46060c768-cert\") pod \"llmisvc-controller-manager-654c557856-dmsl9\" (UID: \"8a5d9c9f-1e82-458e-b43e-18d46060c768\") " pod="kserve/llmisvc-controller-manager-654c557856-dmsl9"
Jul 10 19:05:32.873598 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.873485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqx88\" (UniqueName: \"kubernetes.io/projected/8a5d9c9f-1e82-458e-b43e-18d46060c768-kube-api-access-gqx88\") pod \"llmisvc-controller-manager-654c557856-dmsl9\" (UID: \"8a5d9c9f-1e82-458e-b43e-18d46060c768\") " pod="kserve/llmisvc-controller-manager-654c557856-dmsl9"
Jul 10 19:05:32.875841 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.875817    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a5d9c9f-1e82-458e-b43e-18d46060c768-cert\") pod \"llmisvc-controller-manager-654c557856-dmsl9\" (UID: \"8a5d9c9f-1e82-458e-b43e-18d46060c768\") " pod="kserve/llmisvc-controller-manager-654c557856-dmsl9"
Jul 10 19:05:32.883753 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.883725    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqx88\" (UniqueName: \"kubernetes.io/projected/8a5d9c9f-1e82-458e-b43e-18d46060c768-kube-api-access-gqx88\") pod \"llmisvc-controller-manager-654c557856-dmsl9\" (UID: \"8a5d9c9f-1e82-458e-b43e-18d46060c768\") " pod="kserve/llmisvc-controller-manager-654c557856-dmsl9"
Jul 10 19:05:32.917309 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:32.917287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-dmsl9"
Jul 10 19:05:33.053259 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:33.053227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-dmsl9"]
Jul 10 19:05:33.056665 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:05:33.056636    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a5d9c9f_1e82_458e_b43e_18d46060c768.slice/crio-7612b619abc5b2b735c466bc8b6886fd015abdd41f6ec5850f74147d8d4f4de1 WatchSource:0}: Error finding container 7612b619abc5b2b735c466bc8b6886fd015abdd41f6ec5850f74147d8d4f4de1: Status 404 returned error can't find the container with id 7612b619abc5b2b735c466bc8b6886fd015abdd41f6ec5850f74147d8d4f4de1
Jul 10 19:05:33.909804 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:33.909759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-dmsl9" event={"ID":"8a5d9c9f-1e82-458e-b43e-18d46060c768","Type":"ContainerStarted","Data":"7612b619abc5b2b735c466bc8b6886fd015abdd41f6ec5850f74147d8d4f4de1"}
Jul 10 19:05:34.660437 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:34.660404    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:05:34.795278 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:34.795220    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:05:35.920623 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:35.920584    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-dmsl9" event={"ID":"8a5d9c9f-1e82-458e-b43e-18d46060c768","Type":"ContainerStarted","Data":"aa8136bd60ee75d792ac2b078a26ee6cd73c4d8f85356d63bc05f55a8d5b8f96"}
Jul 10 19:05:35.921016 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:05:35.920731    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-dmsl9"
Jul 10 19:06:06.926711 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:06.926679    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-dmsl9"
Jul 10 19:06:06.943788 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:06.943740    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-dmsl9" podStartSLOduration=32.903275291 podStartE2EDuration="34.943725543s" totalImagesPullingTime="2.040450252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:05:35.963598601 +0000 UTC m=+435.420149023" watchObservedRunningTime="2026-07-10 19:06:06.943725543 +0000 UTC m=+466.400275920"
Jul 10 19:06:08.346052 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.346019    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-69f6979966-l9w8m"]
Jul 10 19:06:08.352296 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.352270    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-69f6979966-l9w8m"
Jul 10 19:06:08.355765 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.355741    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-tcnd9\""
Jul 10 19:06:08.355878 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.355767    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 10 19:06:08.360537 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.360513    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-69f6979966-l9w8m"]
Jul 10 19:06:08.440184 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.440162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4ed9c30-aa43-4552-b939-e45e130a4714-cert\") pod \"kserve-controller-manager-69f6979966-l9w8m\" (UID: \"e4ed9c30-aa43-4552-b939-e45e130a4714\") " pod="kserve/kserve-controller-manager-69f6979966-l9w8m"
Jul 10 19:06:08.440297 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.440220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzczd\" (UniqueName: \"kubernetes.io/projected/e4ed9c30-aa43-4552-b939-e45e130a4714-kube-api-access-hzczd\") pod \"kserve-controller-manager-69f6979966-l9w8m\" (UID: \"e4ed9c30-aa43-4552-b939-e45e130a4714\") " pod="kserve/kserve-controller-manager-69f6979966-l9w8m"
Jul 10 19:06:08.540654 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.540626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzczd\" (UniqueName: \"kubernetes.io/projected/e4ed9c30-aa43-4552-b939-e45e130a4714-kube-api-access-hzczd\") pod \"kserve-controller-manager-69f6979966-l9w8m\" (UID: \"e4ed9c30-aa43-4552-b939-e45e130a4714\") " pod="kserve/kserve-controller-manager-69f6979966-l9w8m"
Jul 10 19:06:08.540781 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.540674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4ed9c30-aa43-4552-b939-e45e130a4714-cert\") pod \"kserve-controller-manager-69f6979966-l9w8m\" (UID: \"e4ed9c30-aa43-4552-b939-e45e130a4714\") " pod="kserve/kserve-controller-manager-69f6979966-l9w8m"
Jul 10 19:06:08.542876 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.542852    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4ed9c30-aa43-4552-b939-e45e130a4714-cert\") pod \"kserve-controller-manager-69f6979966-l9w8m\" (UID: \"e4ed9c30-aa43-4552-b939-e45e130a4714\") " pod="kserve/kserve-controller-manager-69f6979966-l9w8m"
Jul 10 19:06:08.549001 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.548978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzczd\" (UniqueName: \"kubernetes.io/projected/e4ed9c30-aa43-4552-b939-e45e130a4714-kube-api-access-hzczd\") pod \"kserve-controller-manager-69f6979966-l9w8m\" (UID: \"e4ed9c30-aa43-4552-b939-e45e130a4714\") " pod="kserve/kserve-controller-manager-69f6979966-l9w8m"
Jul 10 19:06:08.662518 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.662476    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-69f6979966-l9w8m"
Jul 10 19:06:08.786583 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:08.786546    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-69f6979966-l9w8m"]
Jul 10 19:06:08.789201 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:06:08.789177    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ed9c30_aa43_4552_b939_e45e130a4714.slice/crio-42dcc01869a7bbbde67548bf33b948aaa9cb18f35de9d790b6c8190dd27d0abf WatchSource:0}: Error finding container 42dcc01869a7bbbde67548bf33b948aaa9cb18f35de9d790b6c8190dd27d0abf: Status 404 returned error can't find the container with id 42dcc01869a7bbbde67548bf33b948aaa9cb18f35de9d790b6c8190dd27d0abf
Jul 10 19:06:09.064152 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:09.064086    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-69f6979966-l9w8m" event={"ID":"e4ed9c30-aa43-4552-b939-e45e130a4714","Type":"ContainerStarted","Data":"42dcc01869a7bbbde67548bf33b948aaa9cb18f35de9d790b6c8190dd27d0abf"}
Jul 10 19:06:12.083611 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:12.083576    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-69f6979966-l9w8m" event={"ID":"e4ed9c30-aa43-4552-b939-e45e130a4714","Type":"ContainerStarted","Data":"671c9603747b310fc470471844f1230936a47deaffa4067ca455d715a9dba3ae"}
Jul 10 19:06:12.083956 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:12.083723    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-69f6979966-l9w8m"
Jul 10 19:06:12.106266 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:12.106216    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-69f6979966-l9w8m" podStartSLOduration=1.6547471809999998 podStartE2EDuration="4.106198117s" totalImagesPullingTime="2.451450936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:06:12.103834636 +0000 UTC m=+471.560385025" watchObservedRunningTime="2026-07-10 19:06:12.106198117 +0000 UTC m=+471.562748495"
Jul 10 19:06:33.658962 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:33.658922    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:33.759177 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:33.759145    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:33.831849 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:33.831818    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:34.485570 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:34.485539    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:34.600388 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:34.600335    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:43.093186 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:43.093155    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-69f6979966-l9w8m"
Jul 10 19:06:44.210232 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:44.210193    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:44.363944 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:44.363917    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:44.499518 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:44.499428    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:44.600830 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:44.600805    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:44.905055 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:44.905014    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688cd655c9-5txf5"]
Jul 10 19:06:45.033158 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:45.033124    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:45.139880 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:45.139847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:45.234197 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:45.234119    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:06:45.335058 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:06:45.335030    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:07:09.926553 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:09.926510    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-688cd655c9-5txf5" podUID="14f6adb7-e4b5-4baa-ae0e-3b4390254053" containerName="console" containerID="cri-o://996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c" gracePeriod=15
Jul 10 19:07:10.160754 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.160728    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:07:10.241404 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.241298    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-trusted-ca-bundle\") pod \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") "
Jul 10 19:07:10.241404 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.241335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcs5k\" (UniqueName: \"kubernetes.io/projected/14f6adb7-e4b5-4baa-ae0e-3b4390254053-kube-api-access-pcs5k\") pod \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") "
Jul 10 19:07:10.241631 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.241418    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-oauth-serving-cert\") pod \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") "
Jul 10 19:07:10.241631 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.241433    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-config\") pod \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") "
Jul 10 19:07:10.241631 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.241453    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-serving-cert\") pod \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") "
Jul 10 19:07:10.241631 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.241478    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-service-ca\") pod \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") "
Jul 10 19:07:10.241631 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.241507    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-oauth-config\") pod \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\" (UID: \"14f6adb7-e4b5-4baa-ae0e-3b4390254053\") "
Jul 10 19:07:10.241880 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.241842    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14f6adb7-e4b5-4baa-ae0e-3b4390254053" (UID: "14f6adb7-e4b5-4baa-ae0e-3b4390254053"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:07:10.241953 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.241921    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-service-ca" (OuterVolumeSpecName: "service-ca") pod "14f6adb7-e4b5-4baa-ae0e-3b4390254053" (UID: "14f6adb7-e4b5-4baa-ae0e-3b4390254053"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:07:10.242062 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.242031    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-config" (OuterVolumeSpecName: "console-config") pod "14f6adb7-e4b5-4baa-ae0e-3b4390254053" (UID: "14f6adb7-e4b5-4baa-ae0e-3b4390254053"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:07:10.242196 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.242147    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14f6adb7-e4b5-4baa-ae0e-3b4390254053" (UID: "14f6adb7-e4b5-4baa-ae0e-3b4390254053"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:07:10.243665 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.243643    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14f6adb7-e4b5-4baa-ae0e-3b4390254053" (UID: "14f6adb7-e4b5-4baa-ae0e-3b4390254053"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:07:10.243753 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.243735    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14f6adb7-e4b5-4baa-ae0e-3b4390254053-kube-api-access-pcs5k" (OuterVolumeSpecName: "kube-api-access-pcs5k") pod "14f6adb7-e4b5-4baa-ae0e-3b4390254053" (UID: "14f6adb7-e4b5-4baa-ae0e-3b4390254053"). InnerVolumeSpecName "kube-api-access-pcs5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 19:07:10.243799 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.243781    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14f6adb7-e4b5-4baa-ae0e-3b4390254053" (UID: "14f6adb7-e4b5-4baa-ae0e-3b4390254053"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:07:10.327013 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.326982    2579 generic.go:356] "Generic (PLEG): container finished" podID="14f6adb7-e4b5-4baa-ae0e-3b4390254053" containerID="996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c" exitCode=0
Jul 10 19:07:10.327173 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.327029    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688cd655c9-5txf5"
Jul 10 19:07:10.327173 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.327071    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cd655c9-5txf5" event={"ID":"14f6adb7-e4b5-4baa-ae0e-3b4390254053","Type":"ContainerDied","Data":"996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c"}
Jul 10 19:07:10.327173 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.327117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688cd655c9-5txf5" event={"ID":"14f6adb7-e4b5-4baa-ae0e-3b4390254053","Type":"ContainerDied","Data":"0182891b8f2e7c6cf7829006e2a4953c383056885b1f0be61ebc0518046bfca2"}
Jul 10 19:07:10.327173 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.327142    2579 scope.go:117] "RemoveContainer" containerID="996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c"
Jul 10 19:07:10.336027 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.336013    2579 scope.go:117] "RemoveContainer" containerID="996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c"
Jul 10 19:07:10.336279 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:07:10.336261    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c\": container with ID starting with 996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c not found: ID does not exist" containerID="996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c"
Jul 10 19:07:10.336349 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.336291    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c"} err="failed to get container status \"996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c\": rpc error: code = NotFound desc = could not find container \"996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c\": container with ID starting with 996926e10f31ab96c2bcca6a511953ab81cb1b50ed0250cf0545f11f5245be8c not found: ID does not exist"
Jul 10 19:07:10.342279 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.342261    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-oauth-config\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:07:10.342410 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.342281    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-trusted-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:07:10.342410 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.342294    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcs5k\" (UniqueName: \"kubernetes.io/projected/14f6adb7-e4b5-4baa-ae0e-3b4390254053-kube-api-access-pcs5k\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:07:10.342410 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.342306    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-oauth-serving-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:07:10.342410 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.342317    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-config\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:07:10.342410 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.342330    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14f6adb7-e4b5-4baa-ae0e-3b4390254053-console-serving-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:07:10.342410 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.342342    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14f6adb7-e4b5-4baa-ae0e-3b4390254053-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:07:10.349481 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.349459    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688cd655c9-5txf5"]
Jul 10 19:07:10.353079 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:10.353060    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-688cd655c9-5txf5"]
Jul 10 19:07:11.123468 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:11.123420    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14f6adb7-e4b5-4baa-ae0e-3b4390254053" path="/var/lib/kubelet/pods/14f6adb7-e4b5-4baa-ae0e-3b4390254053/volumes"
Jul 10 19:07:22.704183 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:22.704147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:07:51.660356 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:07:51.660323    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:08:00.440734 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:08:00.440664    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:08:00.541976 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:08:00.541948    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:08:20.908062 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:08:20.908033    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:08:20.908062 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:08:20.908047    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:08:20.912530 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:08:20.912513    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:08:20.912639 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:08:20.912536    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:08:40.668032 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:08:40.667994    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:08:40.769505 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:08:40.769450    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:08:52.007110 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:08:52.007076    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:08:53.236703 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:08:53.236675    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:10:11.954159 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:11.954126    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"]
Jul 10 19:10:11.954563 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:11.954482    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14f6adb7-e4b5-4baa-ae0e-3b4390254053" containerName="console"
Jul 10 19:10:11.954563 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:11.954495    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="14f6adb7-e4b5-4baa-ae0e-3b4390254053" containerName="console"
Jul 10 19:10:11.954563 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:11.954560    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="14f6adb7-e4b5-4baa-ae0e-3b4390254053" containerName="console"
Jul 10 19:10:11.957339 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:11.957323    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:11.962213 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:11.962185    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-hm6ps\""
Jul 10 19:10:11.962467 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:11.962444    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-ac00e-serving-cert\""
Jul 10 19:10:11.962592 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:11.962461    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-ac00e-kube-rbac-proxy-sar-config\""
Jul 10 19:10:11.963207 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:11.963187    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 10 19:10:11.964443 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:11.964362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:10:11.969301 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:11.969280    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"]
Jul 10 19:10:12.053188 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:12.053150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-openshift-service-ca-bundle\") pod \"switch-graph-ac00e-8445bbc489-kn8km\" (UID: \"14c9005c-bfc8-44a3-b8d0-c7a045bcd708\") " pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:12.053363 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:12.053228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-proxy-tls\") pod \"switch-graph-ac00e-8445bbc489-kn8km\" (UID: \"14c9005c-bfc8-44a3-b8d0-c7a045bcd708\") " pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:12.153561 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:12.153535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-openshift-service-ca-bundle\") pod \"switch-graph-ac00e-8445bbc489-kn8km\" (UID: \"14c9005c-bfc8-44a3-b8d0-c7a045bcd708\") " pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:12.153713 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:12.153575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-proxy-tls\") pod \"switch-graph-ac00e-8445bbc489-kn8km\" (UID: \"14c9005c-bfc8-44a3-b8d0-c7a045bcd708\") " pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:12.153713 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:10:12.153674    2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-ac00e-serving-cert: secret "switch-graph-ac00e-serving-cert" not found
Jul 10 19:10:12.153815 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:10:12.153732    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-proxy-tls podName:14c9005c-bfc8-44a3-b8d0-c7a045bcd708 nodeName:}" failed. No retries permitted until 2026-07-10 19:10:12.653715801 +0000 UTC m=+712.110266157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-proxy-tls") pod "switch-graph-ac00e-8445bbc489-kn8km" (UID: "14c9005c-bfc8-44a3-b8d0-c7a045bcd708") : secret "switch-graph-ac00e-serving-cert" not found
Jul 10 19:10:12.154348 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:12.154323    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-openshift-service-ca-bundle\") pod \"switch-graph-ac00e-8445bbc489-kn8km\" (UID: \"14c9005c-bfc8-44a3-b8d0-c7a045bcd708\") " pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:12.500404 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:12.500355    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:10:12.657848 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:12.657821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-proxy-tls\") pod \"switch-graph-ac00e-8445bbc489-kn8km\" (UID: \"14c9005c-bfc8-44a3-b8d0-c7a045bcd708\") " pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:12.660064 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:12.660047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-proxy-tls\") pod \"switch-graph-ac00e-8445bbc489-kn8km\" (UID: \"14c9005c-bfc8-44a3-b8d0-c7a045bcd708\") " pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:12.867325 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:12.867268    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:12.994250 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:12.994221    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"]
Jul 10 19:10:12.996045 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:10:12.996008    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c9005c_bfc8_44a3_b8d0_c7a045bcd708.slice/crio-f343d8ced796e5b185829837fa7702b6292b43585d4ed51fd59c59108d32fb69 WatchSource:0}: Error finding container f343d8ced796e5b185829837fa7702b6292b43585d4ed51fd59c59108d32fb69: Status 404 returned error can't find the container with id f343d8ced796e5b185829837fa7702b6292b43585d4ed51fd59c59108d32fb69
Jul 10 19:10:12.997900 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:12.997884    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 19:10:13.074533 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:13.074481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" event={"ID":"14c9005c-bfc8-44a3-b8d0-c7a045bcd708","Type":"ContainerStarted","Data":"f343d8ced796e5b185829837fa7702b6292b43585d4ed51fd59c59108d32fb69"}
Jul 10 19:10:16.090314 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:16.090275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" event={"ID":"14c9005c-bfc8-44a3-b8d0-c7a045bcd708","Type":"ContainerStarted","Data":"43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19"}
Jul 10 19:10:16.090716 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:16.090420    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:16.106601 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:16.106547    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" podStartSLOduration=2.889143047 podStartE2EDuration="5.106536154s" totalImagesPullingTime="2.217393107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:10:16.105754689 +0000 UTC m=+715.562305065" watchObservedRunningTime="2026-07-10 19:10:16.106536154 +0000 UTC m=+715.563086531"
Jul 10 19:10:22.101153 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:22.101123    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:26.097135 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:26.097105    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"]
Jul 10 19:10:26.097528 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:26.097302    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" podUID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" containerName="switch-graph-ac00e" containerID="cri-o://43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19" gracePeriod=30
Jul 10 19:10:26.121045 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:26.121018    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:10:26.266880 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:26.266846    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:10:26.353054 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:26.352982    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:10:26.425624 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:26.425591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:10:26.496804 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:26.496773    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:10:27.087628 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:27.087592    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:10:27.099041 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:27.098997    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" podUID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" containerName="switch-graph-ac00e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:10:32.099710 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:32.099671    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" podUID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" containerName="switch-graph-ac00e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:10:37.099731 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:37.099691    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" podUID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" containerName="switch-graph-ac00e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:10:37.100140 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:37.099807    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:42.099604 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:42.099562    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" podUID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" containerName="switch-graph-ac00e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:10:47.099713 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:47.099675    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" podUID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" containerName="switch-graph-ac00e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:10:51.969499 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:51.969470    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"]
Jul 10 19:10:51.971875 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:51.971848    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:10:51.976086 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:51.976069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:10:51.978477 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:51.978460    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Jul 10 19:10:51.979305 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:51.979289    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Jul 10 19:10:51.983056 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:51.983037    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"]
Jul 10 19:10:52.099145 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:52.099104    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" podUID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" containerName="switch-graph-ac00e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:10:52.113235 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:52.113205    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:10:52.143570 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:52.143548    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-openshift-service-ca-bundle\") pod \"model-chainer-7f4bd5d665-zszjv\" (UID: \"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384\") " pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:10:52.143661 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:52.143573    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-proxy-tls\") pod \"model-chainer-7f4bd5d665-zszjv\" (UID: \"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384\") " pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:10:52.244362 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:52.244303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-openshift-service-ca-bundle\") pod \"model-chainer-7f4bd5d665-zszjv\" (UID: \"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384\") " pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:10:52.244362 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:52.244329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-proxy-tls\") pod \"model-chainer-7f4bd5d665-zszjv\" (UID: \"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384\") " pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:10:52.244949 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:52.244926    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-openshift-service-ca-bundle\") pod \"model-chainer-7f4bd5d665-zszjv\" (UID: \"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384\") " pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:10:52.246528 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:52.246508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-proxy-tls\") pod \"model-chainer-7f4bd5d665-zszjv\" (UID: \"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384\") " pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:10:52.287066 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:52.287044    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:10:52.421672 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:52.421645    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"]
Jul 10 19:10:52.423765 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:10:52.423737    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc43bd7e_4b98_436b_bbd2_55d6f2c7b384.slice/crio-8c75c26093bc54e844d455f2e89dbb0dc62c450101aed0dc472006c64e64482c WatchSource:0}: Error finding container 8c75c26093bc54e844d455f2e89dbb0dc62c450101aed0dc472006c64e64482c: Status 404 returned error can't find the container with id 8c75c26093bc54e844d455f2e89dbb0dc62c450101aed0dc472006c64e64482c
Jul 10 19:10:53.237730 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:53.237700    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" event={"ID":"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384","Type":"ContainerStarted","Data":"27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72"}
Jul 10 19:10:53.238130 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:53.237747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" event={"ID":"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384","Type":"ContainerStarted","Data":"8c75c26093bc54e844d455f2e89dbb0dc62c450101aed0dc472006c64e64482c"}
Jul 10 19:10:53.238130 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:53.237787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:10:53.256614 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:53.256575    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" podStartSLOduration=2.256562725 podStartE2EDuration="2.256562725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:10:53.255131834 +0000 UTC m=+752.711682211" watchObservedRunningTime="2026-07-10 19:10:53.256562725 +0000 UTC m=+752.713113103"
Jul 10 19:10:56.241924 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.241897    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:56.250850 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.250827    2579 generic.go:356] "Generic (PLEG): container finished" podID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" containerID="43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19" exitCode=0
Jul 10 19:10:56.250971 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.250882    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"
Jul 10 19:10:56.250971 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.250907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" event={"ID":"14c9005c-bfc8-44a3-b8d0-c7a045bcd708","Type":"ContainerDied","Data":"43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19"}
Jul 10 19:10:56.250971 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.250952    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km" event={"ID":"14c9005c-bfc8-44a3-b8d0-c7a045bcd708","Type":"ContainerDied","Data":"f343d8ced796e5b185829837fa7702b6292b43585d4ed51fd59c59108d32fb69"}
Jul 10 19:10:56.251162 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.250978    2579 scope.go:117] "RemoveContainer" containerID="43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19"
Jul 10 19:10:56.260538 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.260492    2579 scope.go:117] "RemoveContainer" containerID="43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19"
Jul 10 19:10:56.260854 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:10:56.260827    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19\": container with ID starting with 43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19 not found: ID does not exist" containerID="43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19"
Jul 10 19:10:56.260946 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.260861    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19"} err="failed to get container status \"43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19\": rpc error: code = NotFound desc = could not find container \"43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19\": container with ID starting with 43664f012e6b7fd32fc67cf3b769f1c8c0a243e377ca90898fba03bed05fbe19 not found: ID does not exist"
Jul 10 19:10:56.377869 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.377848    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-proxy-tls\") pod \"14c9005c-bfc8-44a3-b8d0-c7a045bcd708\" (UID: \"14c9005c-bfc8-44a3-b8d0-c7a045bcd708\") "
Jul 10 19:10:56.377985 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.377923    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-openshift-service-ca-bundle\") pod \"14c9005c-bfc8-44a3-b8d0-c7a045bcd708\" (UID: \"14c9005c-bfc8-44a3-b8d0-c7a045bcd708\") "
Jul 10 19:10:56.378242 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.378222    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "14c9005c-bfc8-44a3-b8d0-c7a045bcd708" (UID: "14c9005c-bfc8-44a3-b8d0-c7a045bcd708"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:10:56.379839 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.379821    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "14c9005c-bfc8-44a3-b8d0-c7a045bcd708" (UID: "14c9005c-bfc8-44a3-b8d0-c7a045bcd708"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:10:56.479025 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.479000    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-openshift-service-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:10:56.479025 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.479020    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/14c9005c-bfc8-44a3-b8d0-c7a045bcd708-proxy-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:10:56.571813 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.571787    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"]
Jul 10 19:10:56.575399 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:56.575358    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ac00e-8445bbc489-kn8km"]
Jul 10 19:10:57.122619 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:57.122588    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" path="/var/lib/kubelet/pods/14c9005c-bfc8-44a3-b8d0-c7a045bcd708/volumes"
Jul 10 19:10:59.246788 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:10:59.246759    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:11:02.080569 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:02.080540    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"]
Jul 10 19:11:02.080995 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:02.080828    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" podUID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" containerName="model-chainer" containerID="cri-o://27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72" gracePeriod=30
Jul 10 19:11:02.108894 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:02.108841    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:11:02.185321 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:02.185286    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:11:02.272050 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:02.272016    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:11:02.390194 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:02.390163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:11:02.478610 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:02.478580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:11:02.552051 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:02.552020    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:11:02.656060 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:02.655991    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:11:04.245330 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:04.245297    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" podUID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:11:09.245346 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:09.245304    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" podUID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:11:14.245637 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:14.245600    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" podUID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:11:14.246101 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:14.245716    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:11:19.245248 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:19.245210    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" podUID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:11:24.245418 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:24.245383    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" podUID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:11:26.404112 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.404078    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"]
Jul 10 19:11:26.404483 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.404426    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" containerName="switch-graph-ac00e"
Jul 10 19:11:26.404483 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.404438    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" containerName="switch-graph-ac00e"
Jul 10 19:11:26.404560 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.404489    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="14c9005c-bfc8-44a3-b8d0-c7a045bcd708" containerName="switch-graph-ac00e"
Jul 10 19:11:26.408586 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.408564    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:11:26.411055 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.411039    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-4aae5-serving-cert\""
Jul 10 19:11:26.411483 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.411467    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-4aae5-kube-rbac-proxy-sar-config\""
Jul 10 19:11:26.418574 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.418556    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"]
Jul 10 19:11:26.426719 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.426699    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:11:26.481766 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.481726    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94da2fcc-2aa2-43fc-9a22-76af036e8afa-openshift-service-ca-bundle\") pod \"switch-graph-4aae5-cdb5c996f-pfs62\" (UID: \"94da2fcc-2aa2-43fc-9a22-76af036e8afa\") " pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:11:26.481912 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.481775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94da2fcc-2aa2-43fc-9a22-76af036e8afa-proxy-tls\") pod \"switch-graph-4aae5-cdb5c996f-pfs62\" (UID: \"94da2fcc-2aa2-43fc-9a22-76af036e8afa\") " pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:11:26.583130 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.583099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94da2fcc-2aa2-43fc-9a22-76af036e8afa-proxy-tls\") pod \"switch-graph-4aae5-cdb5c996f-pfs62\" (UID: \"94da2fcc-2aa2-43fc-9a22-76af036e8afa\") " pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:11:26.583256 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.583165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94da2fcc-2aa2-43fc-9a22-76af036e8afa-openshift-service-ca-bundle\") pod \"switch-graph-4aae5-cdb5c996f-pfs62\" (UID: \"94da2fcc-2aa2-43fc-9a22-76af036e8afa\") " pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:11:26.583256 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:11:26.583235    2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-4aae5-serving-cert: secret "switch-graph-4aae5-serving-cert" not found
Jul 10 19:11:26.583332 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:11:26.583303    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94da2fcc-2aa2-43fc-9a22-76af036e8afa-proxy-tls podName:94da2fcc-2aa2-43fc-9a22-76af036e8afa nodeName:}" failed. No retries permitted until 2026-07-10 19:11:27.083286511 +0000 UTC m=+786.539836868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/94da2fcc-2aa2-43fc-9a22-76af036e8afa-proxy-tls") pod "switch-graph-4aae5-cdb5c996f-pfs62" (UID: "94da2fcc-2aa2-43fc-9a22-76af036e8afa") : secret "switch-graph-4aae5-serving-cert" not found
Jul 10 19:11:26.583725 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.583708    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94da2fcc-2aa2-43fc-9a22-76af036e8afa-openshift-service-ca-bundle\") pod \"switch-graph-4aae5-cdb5c996f-pfs62\" (UID: \"94da2fcc-2aa2-43fc-9a22-76af036e8afa\") " pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:11:26.929612 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:26.929582    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:11:27.087224 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:27.087196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94da2fcc-2aa2-43fc-9a22-76af036e8afa-proxy-tls\") pod \"switch-graph-4aae5-cdb5c996f-pfs62\" (UID: \"94da2fcc-2aa2-43fc-9a22-76af036e8afa\") " pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:11:27.089459 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:27.089433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94da2fcc-2aa2-43fc-9a22-76af036e8afa-proxy-tls\") pod \"switch-graph-4aae5-cdb5c996f-pfs62\" (UID: \"94da2fcc-2aa2-43fc-9a22-76af036e8afa\") " pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:11:27.318210 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:27.318138    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:11:27.457131 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:27.457112    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"]
Jul 10 19:11:27.459614 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:11:27.459586    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94da2fcc_2aa2_43fc_9a22_76af036e8afa.slice/crio-7b5b25003caefdc9c53e810e744758a34e1f301168a76bfa9c61e05cd03e4ba0 WatchSource:0}: Error finding container 7b5b25003caefdc9c53e810e744758a34e1f301168a76bfa9c61e05cd03e4ba0: Status 404 returned error can't find the container with id 7b5b25003caefdc9c53e810e744758a34e1f301168a76bfa9c61e05cd03e4ba0
Jul 10 19:11:28.389837 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:28.389801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" event={"ID":"94da2fcc-2aa2-43fc-9a22-76af036e8afa","Type":"ContainerStarted","Data":"3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe"}
Jul 10 19:11:28.390008 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:28.389861    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" event={"ID":"94da2fcc-2aa2-43fc-9a22-76af036e8afa","Type":"ContainerStarted","Data":"7b5b25003caefdc9c53e810e744758a34e1f301168a76bfa9c61e05cd03e4ba0"}
Jul 10 19:11:28.390008 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:28.389889    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:11:28.411116 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:28.411067    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" podStartSLOduration=2.411053144 podStartE2EDuration="2.411053144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:11:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:11:28.409388463 +0000 UTC m=+787.865938861" watchObservedRunningTime="2026-07-10 19:11:28.411053144 +0000 UTC m=+787.867603522"
Jul 10 19:11:29.245988 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:29.245952    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" podUID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:11:32.257107 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.257080    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:11:32.339163 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.339110    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-proxy-tls\") pod \"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384\" (UID: \"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384\") "
Jul 10 19:11:32.339163 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.339150    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-openshift-service-ca-bundle\") pod \"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384\" (UID: \"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384\") "
Jul 10 19:11:32.339546 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.339519    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" (UID: "bc43bd7e-4b98-436b-bbd2-55d6f2c7b384"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:11:32.340997 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.340976    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" (UID: "bc43bd7e-4b98-436b-bbd2-55d6f2c7b384"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:11:32.406012 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.405982    2579 generic.go:356] "Generic (PLEG): container finished" podID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" containerID="27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72" exitCode=0
Jul 10 19:11:32.406106 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.406022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" event={"ID":"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384","Type":"ContainerDied","Data":"27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72"}
Jul 10 19:11:32.406106 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.406024    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"
Jul 10 19:11:32.406106 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.406060    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv" event={"ID":"bc43bd7e-4b98-436b-bbd2-55d6f2c7b384","Type":"ContainerDied","Data":"8c75c26093bc54e844d455f2e89dbb0dc62c450101aed0dc472006c64e64482c"}
Jul 10 19:11:32.406106 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.406080    2579 scope.go:117] "RemoveContainer" containerID="27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72"
Jul 10 19:11:32.414272 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.414255    2579 scope.go:117] "RemoveContainer" containerID="27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72"
Jul 10 19:11:32.414539 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:11:32.414521    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72\": container with ID starting with 27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72 not found: ID does not exist" containerID="27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72"
Jul 10 19:11:32.414599 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.414545    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72"} err="failed to get container status \"27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72\": rpc error: code = NotFound desc = could not find container \"27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72\": container with ID starting with 27339cd1bc2f0c1fe941412a2473104936605746678094dca99123dc84fa2f72 not found: ID does not exist"
Jul 10 19:11:32.426850 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.426820    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"]
Jul 10 19:11:32.428343 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.428325    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7f4bd5d665-zszjv"]
Jul 10 19:11:32.439648 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.439626    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-proxy-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:11:32.439648 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:32.439648    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384-openshift-service-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:11:33.123083 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:33.123053    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" path="/var/lib/kubelet/pods/bc43bd7e-4b98-436b-bbd2-55d6f2c7b384/volumes"
Jul 10 19:11:34.399061 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:11:34.399033    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:12:02.313550 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.313474    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"]
Jul 10 19:12:02.314035 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.313822    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" containerName="model-chainer"
Jul 10 19:12:02.314035 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.313846    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" containerName="model-chainer"
Jul 10 19:12:02.314035 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.313921    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc43bd7e-4b98-436b-bbd2-55d6f2c7b384" containerName="model-chainer"
Jul 10 19:12:02.314035 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.314020    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:12:02.316938 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.316916    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:12:02.319253 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.319230    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-31f26-serving-cert\""
Jul 10 19:12:02.319253 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.319250    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-31f26-kube-rbac-proxy-sar-config\""
Jul 10 19:12:02.326593 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.326573    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"]
Jul 10 19:12:02.467918 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.467883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc35791b-1a59-4a4e-a6aa-d3020924b710-openshift-service-ca-bundle\") pod \"sequence-graph-31f26-7d88b899d6-c2gdl\" (UID: \"fc35791b-1a59-4a4e-a6aa-d3020924b710\") " pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:12:02.468101 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.467942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc35791b-1a59-4a4e-a6aa-d3020924b710-proxy-tls\") pod \"sequence-graph-31f26-7d88b899d6-c2gdl\" (UID: \"fc35791b-1a59-4a4e-a6aa-d3020924b710\") " pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:12:02.568588 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.568521    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc35791b-1a59-4a4e-a6aa-d3020924b710-openshift-service-ca-bundle\") pod \"sequence-graph-31f26-7d88b899d6-c2gdl\" (UID: \"fc35791b-1a59-4a4e-a6aa-d3020924b710\") " pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:12:02.568588 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.568572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc35791b-1a59-4a4e-a6aa-d3020924b710-proxy-tls\") pod \"sequence-graph-31f26-7d88b899d6-c2gdl\" (UID: \"fc35791b-1a59-4a4e-a6aa-d3020924b710\") " pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:12:02.568740 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:12:02.568678    2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-31f26-serving-cert: secret "sequence-graph-31f26-serving-cert" not found
Jul 10 19:12:02.568773 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:12:02.568742    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc35791b-1a59-4a4e-a6aa-d3020924b710-proxy-tls podName:fc35791b-1a59-4a4e-a6aa-d3020924b710 nodeName:}" failed. No retries permitted until 2026-07-10 19:12:03.06872349 +0000 UTC m=+822.525273864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/fc35791b-1a59-4a4e-a6aa-d3020924b710-proxy-tls") pod "sequence-graph-31f26-7d88b899d6-c2gdl" (UID: "fc35791b-1a59-4a4e-a6aa-d3020924b710") : secret "sequence-graph-31f26-serving-cert" not found
Jul 10 19:12:02.569099 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.569078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc35791b-1a59-4a4e-a6aa-d3020924b710-openshift-service-ca-bundle\") pod \"sequence-graph-31f26-7d88b899d6-c2gdl\" (UID: \"fc35791b-1a59-4a4e-a6aa-d3020924b710\") " pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:12:02.658971 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:02.658945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:12:03.072198 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:03.072173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc35791b-1a59-4a4e-a6aa-d3020924b710-proxy-tls\") pod \"sequence-graph-31f26-7d88b899d6-c2gdl\" (UID: \"fc35791b-1a59-4a4e-a6aa-d3020924b710\") " pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:12:03.074467 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:03.074448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc35791b-1a59-4a4e-a6aa-d3020924b710-proxy-tls\") pod \"sequence-graph-31f26-7d88b899d6-c2gdl\" (UID: \"fc35791b-1a59-4a4e-a6aa-d3020924b710\") " pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:12:03.227399 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:03.227360    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:12:03.351905 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:03.351828    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"]
Jul 10 19:12:03.355278 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:12:03.355252    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc35791b_1a59_4a4e_a6aa_d3020924b710.slice/crio-86bbe2c4dd69f71eb126b13101aecf1c2d8077148054ffd1628bb1b8fae6adf4 WatchSource:0}: Error finding container 86bbe2c4dd69f71eb126b13101aecf1c2d8077148054ffd1628bb1b8fae6adf4: Status 404 returned error can't find the container with id 86bbe2c4dd69f71eb126b13101aecf1c2d8077148054ffd1628bb1b8fae6adf4
Jul 10 19:12:03.540428 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:03.540398    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" event={"ID":"fc35791b-1a59-4a4e-a6aa-d3020924b710","Type":"ContainerStarted","Data":"4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910"}
Jul 10 19:12:03.540559 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:03.540444    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" event={"ID":"fc35791b-1a59-4a4e-a6aa-d3020924b710","Type":"ContainerStarted","Data":"86bbe2c4dd69f71eb126b13101aecf1c2d8077148054ffd1628bb1b8fae6adf4"}
Jul 10 19:12:03.540559 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:03.540531    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:12:03.557147 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:03.557104    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" podStartSLOduration=1.557093004 podStartE2EDuration="1.557093004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:12:03.556259914 +0000 UTC m=+823.012810312" watchObservedRunningTime="2026-07-10 19:12:03.557093004 +0000 UTC m=+823.013643381"
Jul 10 19:12:09.549832 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:09.549790    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:12:49.767501 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:49.767464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:12:54.216898 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:12:54.216860    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:13:20.931887 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:13:20.931805    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:13:20.933398 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:13:20.933357    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:13:20.937951 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:13:20.937931    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:13:20.938605 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:13:20.938584    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:15:16.792391 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:15:16.792300    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:15:18.319663 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:15:18.319615    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:15:44.650887 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:15:44.650849    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:18:20.957029 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:18:20.957001    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:18:20.960342 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:18:20.960316    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:18:20.961473 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:18:20.961455    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:18:20.964392 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:18:20.964361    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:19:41.039318 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:41.039280    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"]
Jul 10 19:19:41.039848 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:41.039657    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" podUID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" containerName="switch-graph-4aae5" containerID="cri-o://3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe" gracePeriod=30
Jul 10 19:19:41.099848 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:41.099812    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:19:41.179760 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:41.179724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:19:41.270611 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:41.270574    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:19:41.352598 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:41.352529    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:19:41.519352 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:41.519320    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:19:41.673608 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:41.673578    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:19:44.396965 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:44.396923    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" podUID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" containerName="switch-graph-4aae5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:19:49.397514 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:49.397475    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" podUID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" containerName="switch-graph-4aae5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:19:54.397877 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:54.397825    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" podUID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" containerName="switch-graph-4aae5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:19:54.398252 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:54.397934    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:19:59.396835 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:19:59.396796    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" podUID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" containerName="switch-graph-4aae5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:20:04.396993 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:04.396955    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" podUID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" containerName="switch-graph-4aae5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:20:09.397250 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:09.397214    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" podUID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" containerName="switch-graph-4aae5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:20:11.193961 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.193933    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:20:11.292549 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.292524    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94da2fcc-2aa2-43fc-9a22-76af036e8afa-proxy-tls\") pod \"94da2fcc-2aa2-43fc-9a22-76af036e8afa\" (UID: \"94da2fcc-2aa2-43fc-9a22-76af036e8afa\") "
Jul 10 19:20:11.292703 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.292582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94da2fcc-2aa2-43fc-9a22-76af036e8afa-openshift-service-ca-bundle\") pod \"94da2fcc-2aa2-43fc-9a22-76af036e8afa\" (UID: \"94da2fcc-2aa2-43fc-9a22-76af036e8afa\") "
Jul 10 19:20:11.293062 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.293038    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94da2fcc-2aa2-43fc-9a22-76af036e8afa-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "94da2fcc-2aa2-43fc-9a22-76af036e8afa" (UID: "94da2fcc-2aa2-43fc-9a22-76af036e8afa"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:20:11.294505 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.294445    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94da2fcc-2aa2-43fc-9a22-76af036e8afa-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "94da2fcc-2aa2-43fc-9a22-76af036e8afa" (UID: "94da2fcc-2aa2-43fc-9a22-76af036e8afa"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:20:11.394132 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.394109    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94da2fcc-2aa2-43fc-9a22-76af036e8afa-proxy-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:20:11.394132 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.394130    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94da2fcc-2aa2-43fc-9a22-76af036e8afa-openshift-service-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:20:11.546565 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.546494    2579 generic.go:356] "Generic (PLEG): container finished" podID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" containerID="3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe" exitCode=0
Jul 10 19:20:11.546565 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.546539    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"
Jul 10 19:20:11.546565 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.546542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" event={"ID":"94da2fcc-2aa2-43fc-9a22-76af036e8afa","Type":"ContainerDied","Data":"3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe"}
Jul 10 19:20:11.546741 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.546599    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62" event={"ID":"94da2fcc-2aa2-43fc-9a22-76af036e8afa","Type":"ContainerDied","Data":"7b5b25003caefdc9c53e810e744758a34e1f301168a76bfa9c61e05cd03e4ba0"}
Jul 10 19:20:11.546741 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.546621    2579 scope.go:117] "RemoveContainer" containerID="3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe"
Jul 10 19:20:11.555004 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.554986    2579 scope.go:117] "RemoveContainer" containerID="3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe"
Jul 10 19:20:11.555244 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:20:11.555226    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe\": container with ID starting with 3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe not found: ID does not exist" containerID="3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe"
Jul 10 19:20:11.555294 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.555252    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe"} err="failed to get container status \"3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe\": rpc error: code = NotFound desc = could not find container \"3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe\": container with ID starting with 3518521eaa613678dcdfe7c857f509fd665c3365e700f311bc8a2c11eef315fe not found: ID does not exist"
Jul 10 19:20:11.568411 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.568391    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"]
Jul 10 19:20:11.572139 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:11.572121    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4aae5-cdb5c996f-pfs62"]
Jul 10 19:20:13.122121 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:13.122087    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" path="/var/lib/kubelet/pods/94da2fcc-2aa2-43fc-9a22-76af036e8afa/volumes"
Jul 10 19:20:17.142600 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:17.142572    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"]
Jul 10 19:20:17.145052 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:17.142752    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" podUID="fc35791b-1a59-4a4e-a6aa-d3020924b710" containerName="sequence-graph-31f26" containerID="cri-o://4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910" gracePeriod=30
Jul 10 19:20:17.175290 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:17.175260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:17.299209 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:17.299171    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:17.391560 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:17.391523    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:17.484691 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:17.484620    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:17.634574 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:17.634545    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:17.817583 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:17.817506    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:19.548828 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:19.548792    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" podUID="fc35791b-1a59-4a4e-a6aa-d3020924b710" containerName="sequence-graph-31f26" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:20:24.548634 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:24.548595    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" podUID="fc35791b-1a59-4a4e-a6aa-d3020924b710" containerName="sequence-graph-31f26" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:20:29.547710 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:29.547671    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" podUID="fc35791b-1a59-4a4e-a6aa-d3020924b710" containerName="sequence-graph-31f26" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:20:29.548054 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:29.547763    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:20:34.548387 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:34.548342    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" podUID="fc35791b-1a59-4a4e-a6aa-d3020924b710" containerName="sequence-graph-31f26" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:20:39.548169 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:39.548116    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" podUID="fc35791b-1a59-4a4e-a6aa-d3020924b710" containerName="sequence-graph-31f26" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:20:41.321899 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.321868    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"]
Jul 10 19:20:41.322281 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.322175    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" containerName="switch-graph-4aae5"
Jul 10 19:20:41.322281 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.322187    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" containerName="switch-graph-4aae5"
Jul 10 19:20:41.322281 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.322253    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="94da2fcc-2aa2-43fc-9a22-76af036e8afa" containerName="switch-graph-4aae5"
Jul 10 19:20:41.326085 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.326065    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:20:41.328435 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.328412    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-3dba1-kube-rbac-proxy-sar-config\""
Jul 10 19:20:41.328531 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.328446    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-3dba1-serving-cert\""
Jul 10 19:20:41.333135 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.333115    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"]
Jul 10 19:20:41.335541 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.335520    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:41.403095 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.403067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/60e8b2c7-1290-4184-af29-acdde56c15f8-proxy-tls\") pod \"ensemble-graph-3dba1-74bc59c7d7-5c6cv\" (UID: \"60e8b2c7-1290-4184-af29-acdde56c15f8\") " pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:20:41.403254 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.403110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e8b2c7-1290-4184-af29-acdde56c15f8-openshift-service-ca-bundle\") pod \"ensemble-graph-3dba1-74bc59c7d7-5c6cv\" (UID: \"60e8b2c7-1290-4184-af29-acdde56c15f8\") " pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:20:41.504330 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.504305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/60e8b2c7-1290-4184-af29-acdde56c15f8-proxy-tls\") pod \"ensemble-graph-3dba1-74bc59c7d7-5c6cv\" (UID: \"60e8b2c7-1290-4184-af29-acdde56c15f8\") " pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:20:41.504488 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.504337    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e8b2c7-1290-4184-af29-acdde56c15f8-openshift-service-ca-bundle\") pod \"ensemble-graph-3dba1-74bc59c7d7-5c6cv\" (UID: \"60e8b2c7-1290-4184-af29-acdde56c15f8\") " pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:20:41.505024 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.504996    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e8b2c7-1290-4184-af29-acdde56c15f8-openshift-service-ca-bundle\") pod \"ensemble-graph-3dba1-74bc59c7d7-5c6cv\" (UID: \"60e8b2c7-1290-4184-af29-acdde56c15f8\") " pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:20:41.506692 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.506670    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/60e8b2c7-1290-4184-af29-acdde56c15f8-proxy-tls\") pod \"ensemble-graph-3dba1-74bc59c7d7-5c6cv\" (UID: \"60e8b2c7-1290-4184-af29-acdde56c15f8\") " pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:20:41.636727 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.636705    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:20:41.763315 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:41.763245    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"]
Jul 10 19:20:41.765516 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:20:41.765491    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e8b2c7_1290_4184_af29_acdde56c15f8.slice/crio-8ef2659198470c3d4c83c3136d2f2ea1b30618427db83b217601535621cee729 WatchSource:0}: Error finding container 8ef2659198470c3d4c83c3136d2f2ea1b30618427db83b217601535621cee729: Status 404 returned error can't find the container with id 8ef2659198470c3d4c83c3136d2f2ea1b30618427db83b217601535621cee729
Jul 10 19:20:42.363710 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:42.363677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:42.673143 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:42.673111    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" event={"ID":"60e8b2c7-1290-4184-af29-acdde56c15f8","Type":"ContainerStarted","Data":"887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333"}
Jul 10 19:20:42.673284 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:42.673167    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" event={"ID":"60e8b2c7-1290-4184-af29-acdde56c15f8","Type":"ContainerStarted","Data":"8ef2659198470c3d4c83c3136d2f2ea1b30618427db83b217601535621cee729"}
Jul 10 19:20:42.673284 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:42.673205    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:20:42.690666 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:42.690622    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" podStartSLOduration=1.6906074100000001 podStartE2EDuration="1.69060741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:20:42.688740595 +0000 UTC m=+1342.145290972" watchObservedRunningTime="2026-07-10 19:20:42.69060741 +0000 UTC m=+1342.147157788"
Jul 10 19:20:44.548629 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:44.548594    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" podUID="fc35791b-1a59-4a4e-a6aa-d3020924b710" containerName="sequence-graph-31f26" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:20:47.295208 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.295182    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:20:47.347941 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.347916    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc35791b-1a59-4a4e-a6aa-d3020924b710-proxy-tls\") pod \"fc35791b-1a59-4a4e-a6aa-d3020924b710\" (UID: \"fc35791b-1a59-4a4e-a6aa-d3020924b710\") "
Jul 10 19:20:47.348055 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.347955    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc35791b-1a59-4a4e-a6aa-d3020924b710-openshift-service-ca-bundle\") pod \"fc35791b-1a59-4a4e-a6aa-d3020924b710\" (UID: \"fc35791b-1a59-4a4e-a6aa-d3020924b710\") "
Jul 10 19:20:47.348322 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.348298    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc35791b-1a59-4a4e-a6aa-d3020924b710-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "fc35791b-1a59-4a4e-a6aa-d3020924b710" (UID: "fc35791b-1a59-4a4e-a6aa-d3020924b710"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:20:47.349796 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.349774    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc35791b-1a59-4a4e-a6aa-d3020924b710-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fc35791b-1a59-4a4e-a6aa-d3020924b710" (UID: "fc35791b-1a59-4a4e-a6aa-d3020924b710"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:20:47.448632 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.448581    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc35791b-1a59-4a4e-a6aa-d3020924b710-proxy-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:20:47.448632 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.448603    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc35791b-1a59-4a4e-a6aa-d3020924b710-openshift-service-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:20:47.694927 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.694896    2579 generic.go:356] "Generic (PLEG): container finished" podID="fc35791b-1a59-4a4e-a6aa-d3020924b710" containerID="4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910" exitCode=0
Jul 10 19:20:47.695063 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.694944    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"
Jul 10 19:20:47.695063 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.694964    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" event={"ID":"fc35791b-1a59-4a4e-a6aa-d3020924b710","Type":"ContainerDied","Data":"4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910"}
Jul 10 19:20:47.695063 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.695005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl" event={"ID":"fc35791b-1a59-4a4e-a6aa-d3020924b710","Type":"ContainerDied","Data":"86bbe2c4dd69f71eb126b13101aecf1c2d8077148054ffd1628bb1b8fae6adf4"}
Jul 10 19:20:47.695063 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.695025    2579 scope.go:117] "RemoveContainer" containerID="4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910"
Jul 10 19:20:47.703255 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.703235    2579 scope.go:117] "RemoveContainer" containerID="4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910"
Jul 10 19:20:47.703500 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:20:47.703484    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910\": container with ID starting with 4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910 not found: ID does not exist" containerID="4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910"
Jul 10 19:20:47.703561 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.703509    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910"} err="failed to get container status \"4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910\": rpc error: code = NotFound desc = could not find container \"4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910\": container with ID starting with 4114e1a7bc2bdd25a15a1ff66cbf19aa34ae96dc8b8083a4eb6ff3d499438910 not found: ID does not exist"
Jul 10 19:20:47.715271 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.715251    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"]
Jul 10 19:20:47.720291 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:47.720272    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-31f26-7d88b899d6-c2gdl"]
Jul 10 19:20:48.682815 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:48.682785    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:20:49.121862 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:49.121823    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc35791b-1a59-4a4e-a6aa-d3020924b710" path="/var/lib/kubelet/pods/fc35791b-1a59-4a4e-a6aa-d3020924b710/volumes"
Jul 10 19:20:51.388117 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:51.388089    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"]
Jul 10 19:20:51.388529 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:51.388266    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" podUID="60e8b2c7-1290-4184-af29-acdde56c15f8" containerName="ensemble-graph-3dba1" containerID="cri-o://887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333" gracePeriod=30
Jul 10 19:20:51.409332 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:51.409300    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:51.485816 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:51.485774    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:51.562096 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:51.562059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:51.665271 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:51.665202    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:51.759092 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:51.759069    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:52.318167 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:52.318130    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:20:53.682265 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:53.682226    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" podUID="60e8b2c7-1290-4184-af29-acdde56c15f8" containerName="ensemble-graph-3dba1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:20:58.681617 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:20:58.681578    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" podUID="60e8b2c7-1290-4184-af29-acdde56c15f8" containerName="ensemble-graph-3dba1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:21:03.682222 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:03.682183    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" podUID="60e8b2c7-1290-4184-af29-acdde56c15f8" containerName="ensemble-graph-3dba1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:21:03.682656 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:03.682301    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:21:08.682315 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:08.682274    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" podUID="60e8b2c7-1290-4184-af29-acdde56c15f8" containerName="ensemble-graph-3dba1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:21:11.153175 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:11.153135    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:21:13.681877 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:13.681842    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" podUID="60e8b2c7-1290-4184-af29-acdde56c15f8" containerName="ensemble-graph-3dba1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:21:17.363034 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.362994    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"]
Jul 10 19:21:17.363456 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.363439    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc35791b-1a59-4a4e-a6aa-d3020924b710" containerName="sequence-graph-31f26"
Jul 10 19:21:17.363456 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.363457    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc35791b-1a59-4a4e-a6aa-d3020924b710" containerName="sequence-graph-31f26"
Jul 10 19:21:17.363582 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.363508    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc35791b-1a59-4a4e-a6aa-d3020924b710" containerName="sequence-graph-31f26"
Jul 10 19:21:17.366582 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.366565    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:17.368854 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.368831    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-d30ee-serving-cert\""
Jul 10 19:21:17.368975 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.368878    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-d30ee-kube-rbac-proxy-sar-config\""
Jul 10 19:21:17.368975 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.368920    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:21:17.376344 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.376323    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"]
Jul 10 19:21:17.464342 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.464308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-openshift-service-ca-bundle\") pod \"sequence-graph-d30ee-6b65dbc99c-sjpgv\" (UID: \"13ee2214-2cf8-46c3-985f-7335f1bc1aaf\") " pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:17.464342 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.464342    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-proxy-tls\") pod \"sequence-graph-d30ee-6b65dbc99c-sjpgv\" (UID: \"13ee2214-2cf8-46c3-985f-7335f1bc1aaf\") " pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:17.540291 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.540252    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:21:17.565072 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.565048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-openshift-service-ca-bundle\") pod \"sequence-graph-d30ee-6b65dbc99c-sjpgv\" (UID: \"13ee2214-2cf8-46c3-985f-7335f1bc1aaf\") " pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:17.565181 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.565079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-proxy-tls\") pod \"sequence-graph-d30ee-6b65dbc99c-sjpgv\" (UID: \"13ee2214-2cf8-46c3-985f-7335f1bc1aaf\") " pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:17.565665 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.565641    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-openshift-service-ca-bundle\") pod \"sequence-graph-d30ee-6b65dbc99c-sjpgv\" (UID: \"13ee2214-2cf8-46c3-985f-7335f1bc1aaf\") " pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:17.567286 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.567260    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-proxy-tls\") pod \"sequence-graph-d30ee-6b65dbc99c-sjpgv\" (UID: \"13ee2214-2cf8-46c3-985f-7335f1bc1aaf\") " pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:17.676673 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.676653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:17.802852 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.802802    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"]
Jul 10 19:21:17.804964 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:21:17.804937    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ee2214_2cf8_46c3_985f_7335f1bc1aaf.slice/crio-36401c1795b134140f3b912329bb52362d1afec292a03f2db6bb37780e86d90e WatchSource:0}: Error finding container 36401c1795b134140f3b912329bb52362d1afec292a03f2db6bb37780e86d90e: Status 404 returned error can't find the container with id 36401c1795b134140f3b912329bb52362d1afec292a03f2db6bb37780e86d90e
Jul 10 19:21:17.818493 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:17.818469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" event={"ID":"13ee2214-2cf8-46c3-985f-7335f1bc1aaf","Type":"ContainerStarted","Data":"36401c1795b134140f3b912329bb52362d1afec292a03f2db6bb37780e86d90e"}
Jul 10 19:21:18.681427 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:18.681392    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" podUID="60e8b2c7-1290-4184-af29-acdde56c15f8" containerName="ensemble-graph-3dba1" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:21:18.823963 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:18.823927    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" event={"ID":"13ee2214-2cf8-46c3-985f-7335f1bc1aaf","Type":"ContainerStarted","Data":"fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1"}
Jul 10 19:21:18.824106 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:18.824075    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:18.840989 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:18.840950    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" podStartSLOduration=1.840936193 podStartE2EDuration="1.840936193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:21:18.840540683 +0000 UTC m=+1378.297091062" watchObservedRunningTime="2026-07-10 19:21:18.840936193 +0000 UTC m=+1378.297486575"
Jul 10 19:21:21.530225 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.530200    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:21:21.592724 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.592698    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/60e8b2c7-1290-4184-af29-acdde56c15f8-proxy-tls\") pod \"60e8b2c7-1290-4184-af29-acdde56c15f8\" (UID: \"60e8b2c7-1290-4184-af29-acdde56c15f8\") "
Jul 10 19:21:21.592828 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.592784    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e8b2c7-1290-4184-af29-acdde56c15f8-openshift-service-ca-bundle\") pod \"60e8b2c7-1290-4184-af29-acdde56c15f8\" (UID: \"60e8b2c7-1290-4184-af29-acdde56c15f8\") "
Jul 10 19:21:21.593121 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.593092    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60e8b2c7-1290-4184-af29-acdde56c15f8-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "60e8b2c7-1290-4184-af29-acdde56c15f8" (UID: "60e8b2c7-1290-4184-af29-acdde56c15f8"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:21:21.594564 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.594543    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60e8b2c7-1290-4184-af29-acdde56c15f8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "60e8b2c7-1290-4184-af29-acdde56c15f8" (UID: "60e8b2c7-1290-4184-af29-acdde56c15f8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:21:21.693836 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.693779    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60e8b2c7-1290-4184-af29-acdde56c15f8-openshift-service-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:21:21.693836 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.693798    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/60e8b2c7-1290-4184-af29-acdde56c15f8-proxy-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:21:21.837430 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.837403    2579 generic.go:356] "Generic (PLEG): container finished" podID="60e8b2c7-1290-4184-af29-acdde56c15f8" containerID="887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333" exitCode=0
Jul 10 19:21:21.837561 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.837452    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"
Jul 10 19:21:21.837561 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.837453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" event={"ID":"60e8b2c7-1290-4184-af29-acdde56c15f8","Type":"ContainerDied","Data":"887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333"}
Jul 10 19:21:21.837635 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.837586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv" event={"ID":"60e8b2c7-1290-4184-af29-acdde56c15f8","Type":"ContainerDied","Data":"8ef2659198470c3d4c83c3136d2f2ea1b30618427db83b217601535621cee729"}
Jul 10 19:21:21.837667 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.837622    2579 scope.go:117] "RemoveContainer" containerID="887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333"
Jul 10 19:21:21.848062 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.848041    2579 scope.go:117] "RemoveContainer" containerID="887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333"
Jul 10 19:21:21.848344 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:21:21.848322    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333\": container with ID starting with 887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333 not found: ID does not exist" containerID="887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333"
Jul 10 19:21:21.848402 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.848355    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333"} err="failed to get container status \"887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333\": rpc error: code = NotFound desc = could not find container \"887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333\": container with ID starting with 887e37ead2b751aab2ca23e4871f95ba9272ecc988caacfdcf49cc4326dd9333 not found: ID does not exist"
Jul 10 19:21:21.858943 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.858921    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"]
Jul 10 19:21:21.862248 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:21.862228    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3dba1-74bc59c7d7-5c6cv"]
Jul 10 19:21:23.122072 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:23.122029    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60e8b2c7-1290-4184-af29-acdde56c15f8" path="/var/lib/kubelet/pods/60e8b2c7-1290-4184-af29-acdde56c15f8/volumes"
Jul 10 19:21:24.833861 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:24.833832    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:27.540540 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:27.540512    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"]
Jul 10 19:21:27.540910 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:27.540690    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" podUID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" containerName="sequence-graph-d30ee" containerID="cri-o://fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1" gracePeriod=30
Jul 10 19:21:27.567545 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:27.567516    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:21:27.644713 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:27.644669    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:21:27.721302 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:27.721269    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:21:27.788337 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:27.788309    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:21:28.002169 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:28.002138    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:21:28.103360 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:28.103327    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:21:29.832814 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:29.832776    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" podUID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" containerName="sequence-graph-d30ee" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:21:34.832220 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:34.832178    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" podUID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" containerName="sequence-graph-d30ee" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:21:39.832323 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:39.832281    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" podUID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" containerName="sequence-graph-d30ee" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:21:39.832793 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:39.832447    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:44.832414 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:44.832365    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" podUID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" containerName="sequence-graph-d30ee" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:21:49.832775 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:49.832723    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" podUID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" containerName="sequence-graph-d30ee" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:21:54.832334 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:54.832290    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" podUID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" containerName="sequence-graph-d30ee" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:21:57.722923 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.722898    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:57.864584 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.864511    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-proxy-tls\") pod \"13ee2214-2cf8-46c3-985f-7335f1bc1aaf\" (UID: \"13ee2214-2cf8-46c3-985f-7335f1bc1aaf\") "
Jul 10 19:21:57.864584 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.864564    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-openshift-service-ca-bundle\") pod \"13ee2214-2cf8-46c3-985f-7335f1bc1aaf\" (UID: \"13ee2214-2cf8-46c3-985f-7335f1bc1aaf\") "
Jul 10 19:21:57.864932 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.864909    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "13ee2214-2cf8-46c3-985f-7335f1bc1aaf" (UID: "13ee2214-2cf8-46c3-985f-7335f1bc1aaf"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:21:57.866431 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.866409    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "13ee2214-2cf8-46c3-985f-7335f1bc1aaf" (UID: "13ee2214-2cf8-46c3-985f-7335f1bc1aaf"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:21:57.965426 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.965402    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-proxy-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:21:57.965426 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.965423    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13ee2214-2cf8-46c3-985f-7335f1bc1aaf-openshift-service-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:21:57.990043 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.990017    2579 generic.go:356] "Generic (PLEG): container finished" podID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" containerID="fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1" exitCode=0
Jul 10 19:21:57.990148 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.990055    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"
Jul 10 19:21:57.990148 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.990097    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" event={"ID":"13ee2214-2cf8-46c3-985f-7335f1bc1aaf","Type":"ContainerDied","Data":"fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1"}
Jul 10 19:21:57.990148 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.990142    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv" event={"ID":"13ee2214-2cf8-46c3-985f-7335f1bc1aaf","Type":"ContainerDied","Data":"36401c1795b134140f3b912329bb52362d1afec292a03f2db6bb37780e86d90e"}
Jul 10 19:21:57.990253 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.990165    2579 scope.go:117] "RemoveContainer" containerID="fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1"
Jul 10 19:21:57.999296 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:57.999232    2579 scope.go:117] "RemoveContainer" containerID="fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1"
Jul 10 19:21:58.000516 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:21:58.000493    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1\": container with ID starting with fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1 not found: ID does not exist" containerID="fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1"
Jul 10 19:21:58.000603 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:58.000523    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1"} err="failed to get container status \"fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1\": rpc error: code = NotFound desc = could not find container \"fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1\": container with ID starting with fab361d89c212e7c702b01e11818f27adee2bcde807665dcc6dd1c3229af71f1 not found: ID does not exist"
Jul 10 19:21:58.012276 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:58.012256    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"]
Jul 10 19:21:58.015380 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:58.015347    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-d30ee-6b65dbc99c-sjpgv"]
Jul 10 19:21:59.122112 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:21:59.122072    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" path="/var/lib/kubelet/pods/13ee2214-2cf8-46c3-985f-7335f1bc1aaf/volumes"
Jul 10 19:22:01.639178 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.639146    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"]
Jul 10 19:22:01.639543 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.639460    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" containerName="sequence-graph-d30ee"
Jul 10 19:22:01.639543 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.639472    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" containerName="sequence-graph-d30ee"
Jul 10 19:22:01.639543 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.639486    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60e8b2c7-1290-4184-af29-acdde56c15f8" containerName="ensemble-graph-3dba1"
Jul 10 19:22:01.639543 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.639492    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="60e8b2c7-1290-4184-af29-acdde56c15f8" containerName="ensemble-graph-3dba1"
Jul 10 19:22:01.639543 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.639540    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="13ee2214-2cf8-46c3-985f-7335f1bc1aaf" containerName="sequence-graph-d30ee"
Jul 10 19:22:01.639729 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.639549    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="60e8b2c7-1290-4184-af29-acdde56c15f8" containerName="ensemble-graph-3dba1"
Jul 10 19:22:01.643773 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.643754    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:22:01.646523 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.646505    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-hm6ps\""
Jul 10 19:22:01.646627 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.646522    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 10 19:22:01.646627 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.646525    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-d232d-serving-cert\""
Jul 10 19:22:01.646627 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.646508    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-d232d-kube-rbac-proxy-sar-config\""
Jul 10 19:22:01.651847 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.651827    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"]
Jul 10 19:22:01.654827 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.654797    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:22:01.691766 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.691739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/231cd065-32fe-423a-8b03-c900b2721e41-openshift-service-ca-bundle\") pod \"ensemble-graph-d232d-596f769657-56w4v\" (UID: \"231cd065-32fe-423a-8b03-c900b2721e41\") " pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:22:01.691876 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.691806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/231cd065-32fe-423a-8b03-c900b2721e41-proxy-tls\") pod \"ensemble-graph-d232d-596f769657-56w4v\" (UID: \"231cd065-32fe-423a-8b03-c900b2721e41\") " pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:22:01.793075 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.793048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/231cd065-32fe-423a-8b03-c900b2721e41-proxy-tls\") pod \"ensemble-graph-d232d-596f769657-56w4v\" (UID: \"231cd065-32fe-423a-8b03-c900b2721e41\") " pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:22:01.793256 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.793103    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/231cd065-32fe-423a-8b03-c900b2721e41-openshift-service-ca-bundle\") pod \"ensemble-graph-d232d-596f769657-56w4v\" (UID: \"231cd065-32fe-423a-8b03-c900b2721e41\") " pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:22:01.793256 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:22:01.793202    2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-d232d-serving-cert: secret "ensemble-graph-d232d-serving-cert" not found
Jul 10 19:22:01.793401 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:22:01.793289    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/231cd065-32fe-423a-8b03-c900b2721e41-proxy-tls podName:231cd065-32fe-423a-8b03-c900b2721e41 nodeName:}" failed. No retries permitted until 2026-07-10 19:22:02.293269253 +0000 UTC m=+1421.749819611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/231cd065-32fe-423a-8b03-c900b2721e41-proxy-tls") pod "ensemble-graph-d232d-596f769657-56w4v" (UID: "231cd065-32fe-423a-8b03-c900b2721e41") : secret "ensemble-graph-d232d-serving-cert" not found
Jul 10 19:22:01.793682 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:01.793664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/231cd065-32fe-423a-8b03-c900b2721e41-openshift-service-ca-bundle\") pod \"ensemble-graph-d232d-596f769657-56w4v\" (UID: \"231cd065-32fe-423a-8b03-c900b2721e41\") " pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:22:02.239364 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:02.239318    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:22:02.297703 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:02.297672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/231cd065-32fe-423a-8b03-c900b2721e41-proxy-tls\") pod \"ensemble-graph-d232d-596f769657-56w4v\" (UID: \"231cd065-32fe-423a-8b03-c900b2721e41\") " pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:22:02.300006 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:02.299980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/231cd065-32fe-423a-8b03-c900b2721e41-proxy-tls\") pod \"ensemble-graph-d232d-596f769657-56w4v\" (UID: \"231cd065-32fe-423a-8b03-c900b2721e41\") " pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:22:02.553863 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:02.553771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:22:02.676884 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:02.676858    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"]
Jul 10 19:22:02.679059 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:22:02.679033    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231cd065_32fe_423a_8b03_c900b2721e41.slice/crio-8ce72c985c84513c2dce5bd2ccaa095f99515336c18aa800c6f3670eaa33cc04 WatchSource:0}: Error finding container 8ce72c985c84513c2dce5bd2ccaa095f99515336c18aa800c6f3670eaa33cc04: Status 404 returned error can't find the container with id 8ce72c985c84513c2dce5bd2ccaa095f99515336c18aa800c6f3670eaa33cc04
Jul 10 19:22:03.020494 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:03.020465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" event={"ID":"231cd065-32fe-423a-8b03-c900b2721e41","Type":"ContainerStarted","Data":"434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621"}
Jul 10 19:22:03.020659 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:03.020515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" event={"ID":"231cd065-32fe-423a-8b03-c900b2721e41","Type":"ContainerStarted","Data":"8ce72c985c84513c2dce5bd2ccaa095f99515336c18aa800c6f3670eaa33cc04"}
Jul 10 19:22:03.020659 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:03.020577    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:22:03.038123 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:03.038083    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" podStartSLOduration=2.03806984 podStartE2EDuration="2.03806984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:22:03.037251362 +0000 UTC m=+1422.493801758" watchObservedRunningTime="2026-07-10 19:22:03.03806984 +0000 UTC m=+1422.494620217"
Jul 10 19:22:09.030694 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:09.030665    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:22:27.757630 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.757593    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"]
Jul 10 19:22:27.760942 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.760920    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:22:27.763344 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.763295    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-5e7fe-kube-rbac-proxy-sar-config\""
Jul 10 19:22:27.763344 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.763311    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-5e7fe-serving-cert\""
Jul 10 19:22:27.771396 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.771355    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"]
Jul 10 19:22:27.771533 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.771513    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:22:27.786812 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.786786    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c937493-5f66-41aa-ab8d-53963ca388c8-openshift-service-ca-bundle\") pod \"sequence-graph-5e7fe-5586b95c8c-pmgrj\" (UID: \"6c937493-5f66-41aa-ab8d-53963ca388c8\") " pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:22:27.786918 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.786872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c937493-5f66-41aa-ab8d-53963ca388c8-proxy-tls\") pod \"sequence-graph-5e7fe-5586b95c8c-pmgrj\" (UID: \"6c937493-5f66-41aa-ab8d-53963ca388c8\") " pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:22:27.887862 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.887833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c937493-5f66-41aa-ab8d-53963ca388c8-proxy-tls\") pod \"sequence-graph-5e7fe-5586b95c8c-pmgrj\" (UID: \"6c937493-5f66-41aa-ab8d-53963ca388c8\") " pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:22:27.888051 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.887885    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c937493-5f66-41aa-ab8d-53963ca388c8-openshift-service-ca-bundle\") pod \"sequence-graph-5e7fe-5586b95c8c-pmgrj\" (UID: \"6c937493-5f66-41aa-ab8d-53963ca388c8\") " pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:22:27.888051 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:22:27.887992    2579 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-5e7fe-serving-cert: secret "sequence-graph-5e7fe-serving-cert" not found
Jul 10 19:22:27.888133 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:22:27.888067    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c937493-5f66-41aa-ab8d-53963ca388c8-proxy-tls podName:6c937493-5f66-41aa-ab8d-53963ca388c8 nodeName:}" failed. No retries permitted until 2026-07-10 19:22:28.388050584 +0000 UTC m=+1447.844600945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/6c937493-5f66-41aa-ab8d-53963ca388c8-proxy-tls") pod "sequence-graph-5e7fe-5586b95c8c-pmgrj" (UID: "6c937493-5f66-41aa-ab8d-53963ca388c8") : secret "sequence-graph-5e7fe-serving-cert" not found
Jul 10 19:22:27.888487 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.888470    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c937493-5f66-41aa-ab8d-53963ca388c8-openshift-service-ca-bundle\") pod \"sequence-graph-5e7fe-5586b95c8c-pmgrj\" (UID: \"6c937493-5f66-41aa-ab8d-53963ca388c8\") " pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:22:27.964755 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:27.964726    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:22:28.391017 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:28.390985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c937493-5f66-41aa-ab8d-53963ca388c8-proxy-tls\") pod \"sequence-graph-5e7fe-5586b95c8c-pmgrj\" (UID: \"6c937493-5f66-41aa-ab8d-53963ca388c8\") " pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:22:28.393304 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:28.393273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c937493-5f66-41aa-ab8d-53963ca388c8-proxy-tls\") pod \"sequence-graph-5e7fe-5586b95c8c-pmgrj\" (UID: \"6c937493-5f66-41aa-ab8d-53963ca388c8\") " pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:22:28.671116 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:28.671047    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:22:28.798094 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:28.798068    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"]
Jul 10 19:22:28.800041 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:22:28.800017    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c937493_5f66_41aa_ab8d_53963ca388c8.slice/crio-015d979433c5fd2186f2708ca01fe3fc1c342903fe4e23f45f91e6ecdc8628df WatchSource:0}: Error finding container 015d979433c5fd2186f2708ca01fe3fc1c342903fe4e23f45f91e6ecdc8628df: Status 404 returned error can't find the container with id 015d979433c5fd2186f2708ca01fe3fc1c342903fe4e23f45f91e6ecdc8628df
Jul 10 19:22:29.130298 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:29.130266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" event={"ID":"6c937493-5f66-41aa-ab8d-53963ca388c8","Type":"ContainerStarted","Data":"3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5"}
Jul 10 19:22:29.130458 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:29.130312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" event={"ID":"6c937493-5f66-41aa-ab8d-53963ca388c8","Type":"ContainerStarted","Data":"015d979433c5fd2186f2708ca01fe3fc1c342903fe4e23f45f91e6ecdc8628df"}
Jul 10 19:22:29.130458 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:29.130442    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:22:29.148861 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:29.148817    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" podStartSLOduration=2.148806116 podStartE2EDuration="2.148806116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:22:29.147840227 +0000 UTC m=+1448.604390624" watchObservedRunningTime="2026-07-10 19:22:29.148806116 +0000 UTC m=+1448.605356492"
Jul 10 19:22:35.139922 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:22:35.139893    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:23:20.985488 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:23:20.985459    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:23:20.987132 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:23:20.987109    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:23:20.989760 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:23:20.989739    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:23:20.991862 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:23:20.991836    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:23:38.027641 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:23:38.027603    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:28:21.017810 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:28:21.017783    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:28:21.019829 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:28:21.019805    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:28:21.022177 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:28:21.022157    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:28:21.024216 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:28:21.024195    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:29:03.257633 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:29:03.257598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:16.298811 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:16.298721    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"]
Jul 10 19:30:16.299291 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:16.298976    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" podUID="231cd065-32fe-423a-8b03-c900b2721e41" containerName="ensemble-graph-d232d" containerID="cri-o://434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621" gracePeriod=30
Jul 10 19:30:16.327923 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:16.327855    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:16.459855 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:16.459807    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:16.557275 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:16.557184    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:16.629812 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:16.629757    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:16.731124 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:16.731097    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:16.947720 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:16.947687    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:19.028529 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:19.028488    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" podUID="231cd065-32fe-423a-8b03-c900b2721e41" containerName="ensemble-graph-d232d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:30:24.028475 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:24.028438    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" podUID="231cd065-32fe-423a-8b03-c900b2721e41" containerName="ensemble-graph-d232d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:30:29.028178 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:29.028135    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" podUID="231cd065-32fe-423a-8b03-c900b2721e41" containerName="ensemble-graph-d232d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:30:29.028561 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:29.028246    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:30:34.029078 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:34.029042    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" podUID="231cd065-32fe-423a-8b03-c900b2721e41" containerName="ensemble-graph-d232d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:30:39.028245 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:39.028206    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" podUID="231cd065-32fe-423a-8b03-c900b2721e41" containerName="ensemble-graph-d232d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:30:42.379624 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:42.379585    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"]
Jul 10 19:30:42.380029 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:42.379838    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" podUID="6c937493-5f66-41aa-ab8d-53963ca388c8" containerName="sequence-graph-5e7fe" containerID="cri-o://3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5" gracePeriod=30
Jul 10 19:30:42.401441 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:42.401359    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:42.506089 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:42.506058    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:42.581366 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:42.581309    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:42.664781 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:42.664690    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:42.768135 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:42.768034    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:43.019151 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:43.019080    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:30:44.034031 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:44.033994    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" podUID="231cd065-32fe-423a-8b03-c900b2721e41" containerName="ensemble-graph-d232d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:30:45.138982 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:45.138947    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" podUID="6c937493-5f66-41aa-ab8d-53963ca388c8" containerName="sequence-graph-5e7fe" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:30:46.446947 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:46.446923    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:30:46.559069 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:46.559009    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/231cd065-32fe-423a-8b03-c900b2721e41-openshift-service-ca-bundle\") pod \"231cd065-32fe-423a-8b03-c900b2721e41\" (UID: \"231cd065-32fe-423a-8b03-c900b2721e41\") "
Jul 10 19:30:46.559069 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:46.559039    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/231cd065-32fe-423a-8b03-c900b2721e41-proxy-tls\") pod \"231cd065-32fe-423a-8b03-c900b2721e41\" (UID: \"231cd065-32fe-423a-8b03-c900b2721e41\") "
Jul 10 19:30:46.559321 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:46.559298    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/231cd065-32fe-423a-8b03-c900b2721e41-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "231cd065-32fe-423a-8b03-c900b2721e41" (UID: "231cd065-32fe-423a-8b03-c900b2721e41"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:30:46.560931 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:46.560909    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/231cd065-32fe-423a-8b03-c900b2721e41-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "231cd065-32fe-423a-8b03-c900b2721e41" (UID: "231cd065-32fe-423a-8b03-c900b2721e41"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:30:46.659506 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:46.659483    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/231cd065-32fe-423a-8b03-c900b2721e41-openshift-service-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:30:46.659506 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:46.659503    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/231cd065-32fe-423a-8b03-c900b2721e41-proxy-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:30:47.183627 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:47.183592    2579 generic.go:356] "Generic (PLEG): container finished" podID="231cd065-32fe-423a-8b03-c900b2721e41" containerID="434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621" exitCode=0
Jul 10 19:30:47.183781 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:47.183635    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"
Jul 10 19:30:47.183781 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:47.183675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" event={"ID":"231cd065-32fe-423a-8b03-c900b2721e41","Type":"ContainerDied","Data":"434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621"}
Jul 10 19:30:47.183781 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:47.183723    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v" event={"ID":"231cd065-32fe-423a-8b03-c900b2721e41","Type":"ContainerDied","Data":"8ce72c985c84513c2dce5bd2ccaa095f99515336c18aa800c6f3670eaa33cc04"}
Jul 10 19:30:47.183781 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:47.183745    2579 scope.go:117] "RemoveContainer" containerID="434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621"
Jul 10 19:30:47.191798 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:47.191781    2579 scope.go:117] "RemoveContainer" containerID="434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621"
Jul 10 19:30:47.191998 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:30:47.191980    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621\": container with ID starting with 434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621 not found: ID does not exist" containerID="434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621"
Jul 10 19:30:47.192054 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:47.192005    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621"} err="failed to get container status \"434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621\": rpc error: code = NotFound desc = could not find container \"434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621\": container with ID starting with 434072faeff39bdd75b018bb6e670dc1215cc4bb1eacbd5c805e91e7c1ec1621 not found: ID does not exist"
Jul 10 19:30:47.200224 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:47.200202    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"]
Jul 10 19:30:47.205383 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:47.205354    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-d232d-596f769657-56w4v"]
Jul 10 19:30:49.126631 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:49.126597    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="231cd065-32fe-423a-8b03-c900b2721e41" path="/var/lib/kubelet/pods/231cd065-32fe-423a-8b03-c900b2721e41/volumes"
Jul 10 19:30:50.138023 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:50.137985    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" podUID="6c937493-5f66-41aa-ab8d-53963ca388c8" containerName="sequence-graph-5e7fe" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:30:55.138464 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:55.138420    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" podUID="6c937493-5f66-41aa-ab8d-53963ca388c8" containerName="sequence-graph-5e7fe" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:30:55.138824 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:30:55.138506    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:31:00.138860 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:00.138824    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" podUID="6c937493-5f66-41aa-ab8d-53963ca388c8" containerName="sequence-graph-5e7fe" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:31:05.138794 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:05.138754    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" podUID="6c937493-5f66-41aa-ab8d-53963ca388c8" containerName="sequence-graph-5e7fe" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:31:10.138955 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:10.138919    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" podUID="6c937493-5f66-41aa-ab8d-53963ca388c8" containerName="sequence-graph-5e7fe" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:31:12.532530 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:12.532507    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:31:12.634556 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:12.634496    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c937493-5f66-41aa-ab8d-53963ca388c8-proxy-tls\") pod \"6c937493-5f66-41aa-ab8d-53963ca388c8\" (UID: \"6c937493-5f66-41aa-ab8d-53963ca388c8\") "
Jul 10 19:31:12.634556 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:12.634540    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c937493-5f66-41aa-ab8d-53963ca388c8-openshift-service-ca-bundle\") pod \"6c937493-5f66-41aa-ab8d-53963ca388c8\" (UID: \"6c937493-5f66-41aa-ab8d-53963ca388c8\") "
Jul 10 19:31:12.634944 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:12.634922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c937493-5f66-41aa-ab8d-53963ca388c8-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6c937493-5f66-41aa-ab8d-53963ca388c8" (UID: "6c937493-5f66-41aa-ab8d-53963ca388c8"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:31:12.636424 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:12.636401    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c937493-5f66-41aa-ab8d-53963ca388c8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6c937493-5f66-41aa-ab8d-53963ca388c8" (UID: "6c937493-5f66-41aa-ab8d-53963ca388c8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:31:12.735931 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:12.735907    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c937493-5f66-41aa-ab8d-53963ca388c8-proxy-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:31:12.735931 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:12.735933    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c937493-5f66-41aa-ab8d-53963ca388c8-openshift-service-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:31:13.287633 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:13.287597    2579 generic.go:356] "Generic (PLEG): container finished" podID="6c937493-5f66-41aa-ab8d-53963ca388c8" containerID="3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5" exitCode=0
Jul 10 19:31:13.287756 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:13.287643    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"
Jul 10 19:31:13.287756 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:13.287684    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" event={"ID":"6c937493-5f66-41aa-ab8d-53963ca388c8","Type":"ContainerDied","Data":"3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5"}
Jul 10 19:31:13.287756 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:13.287738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj" event={"ID":"6c937493-5f66-41aa-ab8d-53963ca388c8","Type":"ContainerDied","Data":"015d979433c5fd2186f2708ca01fe3fc1c342903fe4e23f45f91e6ecdc8628df"}
Jul 10 19:31:13.287873 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:13.287759    2579 scope.go:117] "RemoveContainer" containerID="3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5"
Jul 10 19:31:13.295798 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:13.295783    2579 scope.go:117] "RemoveContainer" containerID="3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5"
Jul 10 19:31:13.296035 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:31:13.296015    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5\": container with ID starting with 3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5 not found: ID does not exist" containerID="3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5"
Jul 10 19:31:13.296106 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:13.296048    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5"} err="failed to get container status \"3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5\": rpc error: code = NotFound desc = could not find container \"3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5\": container with ID starting with 3058ccf4e882f99edd2134f8565bab736f9d4bb76b93b9b365a48c175b9fd2b5 not found: ID does not exist"
Jul 10 19:31:13.303751 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:13.303731    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"]
Jul 10 19:31:13.305692 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:13.305674    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5e7fe-5586b95c8c-pmgrj"]
Jul 10 19:31:15.122299 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:15.122267    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c937493-5f66-41aa-ab8d-53963ca388c8" path="/var/lib/kubelet/pods/6c937493-5f66-41aa-ab8d-53963ca388c8/volumes"
Jul 10 19:31:16.558801 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.558770    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"]
Jul 10 19:31:16.559211 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.559114    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="231cd065-32fe-423a-8b03-c900b2721e41" containerName="ensemble-graph-d232d"
Jul 10 19:31:16.559211 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.559126    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="231cd065-32fe-423a-8b03-c900b2721e41" containerName="ensemble-graph-d232d"
Jul 10 19:31:16.559211 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.559137    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c937493-5f66-41aa-ab8d-53963ca388c8" containerName="sequence-graph-5e7fe"
Jul 10 19:31:16.559211 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.559142    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c937493-5f66-41aa-ab8d-53963ca388c8" containerName="sequence-graph-5e7fe"
Jul 10 19:31:16.559211 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.559198    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="231cd065-32fe-423a-8b03-c900b2721e41" containerName="ensemble-graph-d232d"
Jul 10 19:31:16.559211 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.559210    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c937493-5f66-41aa-ab8d-53963ca388c8" containerName="sequence-graph-5e7fe"
Jul 10 19:31:16.563537 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.563518    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:16.565962 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.565943    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-4b29b-serving-cert\""
Jul 10 19:31:16.565962 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.565947    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-4b29b-kube-rbac-proxy-sar-config\""
Jul 10 19:31:16.566120 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.565952    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 10 19:31:16.566231 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.566217    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-hm6ps\""
Jul 10 19:31:16.573829 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.573807    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"]
Jul 10 19:31:16.587043 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.587018    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:31:16.665201 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.665169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41ebd47-f76f-488e-bd5b-6858d15638d9-openshift-service-ca-bundle\") pod \"splitter-graph-4b29b-7b79559756-thmqw\" (UID: \"c41ebd47-f76f-488e-bd5b-6858d15638d9\") " pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:16.665201 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.665205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c41ebd47-f76f-488e-bd5b-6858d15638d9-proxy-tls\") pod \"splitter-graph-4b29b-7b79559756-thmqw\" (UID: \"c41ebd47-f76f-488e-bd5b-6858d15638d9\") " pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:16.748387 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.748342    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:31:16.766061 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.766031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41ebd47-f76f-488e-bd5b-6858d15638d9-openshift-service-ca-bundle\") pod \"splitter-graph-4b29b-7b79559756-thmqw\" (UID: \"c41ebd47-f76f-488e-bd5b-6858d15638d9\") " pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:16.766182 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.766072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c41ebd47-f76f-488e-bd5b-6858d15638d9-proxy-tls\") pod \"splitter-graph-4b29b-7b79559756-thmqw\" (UID: \"c41ebd47-f76f-488e-bd5b-6858d15638d9\") " pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:16.766635 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.766616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41ebd47-f76f-488e-bd5b-6858d15638d9-openshift-service-ca-bundle\") pod \"splitter-graph-4b29b-7b79559756-thmqw\" (UID: \"c41ebd47-f76f-488e-bd5b-6858d15638d9\") " pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:16.768286 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.768265    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c41ebd47-f76f-488e-bd5b-6858d15638d9-proxy-tls\") pod \"splitter-graph-4b29b-7b79559756-thmqw\" (UID: \"c41ebd47-f76f-488e-bd5b-6858d15638d9\") " pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:16.873736 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.873714    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:16.996971 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:16.996945    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"]
Jul 10 19:31:16.998845 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:31:16.998814    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc41ebd47_f76f_488e_bd5b_6858d15638d9.slice/crio-da96fb365e07c12164af594dec31423ffe91b15aaec6ec5c4ceee2046a8a32ed WatchSource:0}: Error finding container da96fb365e07c12164af594dec31423ffe91b15aaec6ec5c4ceee2046a8a32ed: Status 404 returned error can't find the container with id da96fb365e07c12164af594dec31423ffe91b15aaec6ec5c4ceee2046a8a32ed
Jul 10 19:31:17.308313 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:17.308229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" event={"ID":"c41ebd47-f76f-488e-bd5b-6858d15638d9","Type":"ContainerStarted","Data":"1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515"}
Jul 10 19:31:17.308313 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:17.308280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" event={"ID":"c41ebd47-f76f-488e-bd5b-6858d15638d9","Type":"ContainerStarted","Data":"da96fb365e07c12164af594dec31423ffe91b15aaec6ec5c4ceee2046a8a32ed"}
Jul 10 19:31:17.308555 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:17.308318    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:17.327037 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:17.326989    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" podStartSLOduration=1.326975269 podStartE2EDuration="1.326975269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:31:17.326410971 +0000 UTC m=+1976.782961378" watchObservedRunningTime="2026-07-10 19:31:17.326975269 +0000 UTC m=+1976.783525646"
Jul 10 19:31:23.320150 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:23.320124    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:26.648834 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:26.648806    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"]
Jul 10 19:31:26.649267 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:26.649012    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" podUID="c41ebd47-f76f-488e-bd5b-6858d15638d9" containerName="splitter-graph-4b29b" containerID="cri-o://1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515" gracePeriod=30
Jul 10 19:31:26.665962 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:26.665936    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:31:26.783741 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:26.783701    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:31:26.857185 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:26.857157    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:31:26.969941 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:26.969866    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:31:27.268398 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:27.268294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:31:27.415471 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:27.415430    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:31:28.318124 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:28.318089    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" podUID="c41ebd47-f76f-488e-bd5b-6858d15638d9" containerName="splitter-graph-4b29b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:31:33.317658 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:33.317616    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" podUID="c41ebd47-f76f-488e-bd5b-6858d15638d9" containerName="splitter-graph-4b29b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:31:38.317743 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:38.317695    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" podUID="c41ebd47-f76f-488e-bd5b-6858d15638d9" containerName="splitter-graph-4b29b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:31:38.318117 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:38.317851    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:42.616401 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.616358    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"]
Jul 10 19:31:42.619699 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.619674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:31:42.622163 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.622141    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-1c787-serving-cert\""
Jul 10 19:31:42.622284 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.622144    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-1c787-kube-rbac-proxy-sar-config\""
Jul 10 19:31:42.628931 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.628908    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"]
Jul 10 19:31:42.650200 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.650175    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:31:42.754722 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.754693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c791eec-7293-4aba-83b9-5391cc1ecb15-proxy-tls\") pod \"switch-graph-1c787-7d48d4c4f9-bzp49\" (UID: \"3c791eec-7293-4aba-83b9-5391cc1ecb15\") " pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:31:42.754879 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.754740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c791eec-7293-4aba-83b9-5391cc1ecb15-openshift-service-ca-bundle\") pod \"switch-graph-1c787-7d48d4c4f9-bzp49\" (UID: \"3c791eec-7293-4aba-83b9-5391cc1ecb15\") " pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:31:42.772558 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.772533    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:31:42.855664 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.855638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c791eec-7293-4aba-83b9-5391cc1ecb15-openshift-service-ca-bundle\") pod \"switch-graph-1c787-7d48d4c4f9-bzp49\" (UID: \"3c791eec-7293-4aba-83b9-5391cc1ecb15\") " pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:31:42.855777 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.855728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c791eec-7293-4aba-83b9-5391cc1ecb15-proxy-tls\") pod \"switch-graph-1c787-7d48d4c4f9-bzp49\" (UID: \"3c791eec-7293-4aba-83b9-5391cc1ecb15\") " pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:31:42.856227 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.856205    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c791eec-7293-4aba-83b9-5391cc1ecb15-openshift-service-ca-bundle\") pod \"switch-graph-1c787-7d48d4c4f9-bzp49\" (UID: \"3c791eec-7293-4aba-83b9-5391cc1ecb15\") " pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:31:42.857917 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.857897    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c791eec-7293-4aba-83b9-5391cc1ecb15-proxy-tls\") pod \"switch-graph-1c787-7d48d4c4f9-bzp49\" (UID: \"3c791eec-7293-4aba-83b9-5391cc1ecb15\") " pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:31:42.930574 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:42.930555    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:31:43.052876 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:43.052849    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"]
Jul 10 19:31:43.055083 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:31:43.055050    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c791eec_7293_4aba_83b9_5391cc1ecb15.slice/crio-ad058eaa3b6ee7b2b5a273e750074d67ab8940649a32974c2dcc054276e5854d WatchSource:0}: Error finding container ad058eaa3b6ee7b2b5a273e750074d67ab8940649a32974c2dcc054276e5854d: Status 404 returned error can't find the container with id ad058eaa3b6ee7b2b5a273e750074d67ab8940649a32974c2dcc054276e5854d
Jul 10 19:31:43.318006 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:43.317920    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" podUID="c41ebd47-f76f-488e-bd5b-6858d15638d9" containerName="splitter-graph-4b29b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:31:43.418491 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:43.418457    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" event={"ID":"3c791eec-7293-4aba-83b9-5391cc1ecb15","Type":"ContainerStarted","Data":"3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4"}
Jul 10 19:31:43.418640 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:43.418505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" event={"ID":"3c791eec-7293-4aba-83b9-5391cc1ecb15","Type":"ContainerStarted","Data":"ad058eaa3b6ee7b2b5a273e750074d67ab8940649a32974c2dcc054276e5854d"}
Jul 10 19:31:43.418640 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:43.418563    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:31:43.434302 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:43.434264    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" podStartSLOduration=1.434253777 podStartE2EDuration="1.434253777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:31:43.433074749 +0000 UTC m=+2002.889625127" watchObservedRunningTime="2026-07-10 19:31:43.434253777 +0000 UTC m=+2002.890804154"
Jul 10 19:31:48.318114 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:48.318077    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" podUID="c41ebd47-f76f-488e-bd5b-6858d15638d9" containerName="splitter-graph-4b29b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:31:49.427639 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:49.427614    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:31:53.317538 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:53.317494    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" podUID="c41ebd47-f76f-488e-bd5b-6858d15638d9" containerName="splitter-graph-4b29b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:31:56.799254 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:56.799226    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:56.859357 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:56.859335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41ebd47-f76f-488e-bd5b-6858d15638d9-openshift-service-ca-bundle\") pod \"c41ebd47-f76f-488e-bd5b-6858d15638d9\" (UID: \"c41ebd47-f76f-488e-bd5b-6858d15638d9\") "
Jul 10 19:31:56.859501 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:56.859396    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c41ebd47-f76f-488e-bd5b-6858d15638d9-proxy-tls\") pod \"c41ebd47-f76f-488e-bd5b-6858d15638d9\" (UID: \"c41ebd47-f76f-488e-bd5b-6858d15638d9\") "
Jul 10 19:31:56.859643 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:56.859619    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c41ebd47-f76f-488e-bd5b-6858d15638d9-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "c41ebd47-f76f-488e-bd5b-6858d15638d9" (UID: "c41ebd47-f76f-488e-bd5b-6858d15638d9"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:31:56.861307 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:56.861286    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c41ebd47-f76f-488e-bd5b-6858d15638d9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c41ebd47-f76f-488e-bd5b-6858d15638d9" (UID: "c41ebd47-f76f-488e-bd5b-6858d15638d9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:31:56.960732 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:56.960680    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c41ebd47-f76f-488e-bd5b-6858d15638d9-openshift-service-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:31:56.960732 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:56.960701    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c41ebd47-f76f-488e-bd5b-6858d15638d9-proxy-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:31:57.483593 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:57.483558    2579 generic.go:356] "Generic (PLEG): container finished" podID="c41ebd47-f76f-488e-bd5b-6858d15638d9" containerID="1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515" exitCode=0
Jul 10 19:31:57.483756 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:57.483602    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"
Jul 10 19:31:57.483756 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:57.483622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" event={"ID":"c41ebd47-f76f-488e-bd5b-6858d15638d9","Type":"ContainerDied","Data":"1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515"}
Jul 10 19:31:57.483756 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:57.483670    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw" event={"ID":"c41ebd47-f76f-488e-bd5b-6858d15638d9","Type":"ContainerDied","Data":"da96fb365e07c12164af594dec31423ffe91b15aaec6ec5c4ceee2046a8a32ed"}
Jul 10 19:31:57.483756 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:57.483694    2579 scope.go:117] "RemoveContainer" containerID="1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515"
Jul 10 19:31:57.491869 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:57.491849    2579 scope.go:117] "RemoveContainer" containerID="1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515"
Jul 10 19:31:57.492095 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:31:57.492075    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515\": container with ID starting with 1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515 not found: ID does not exist" containerID="1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515"
Jul 10 19:31:57.492155 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:57.492101    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515"} err="failed to get container status \"1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515\": rpc error: code = NotFound desc = could not find container \"1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515\": container with ID starting with 1317ca757c632379d41295db252b8654168fbefafe14bd210747305fc318d515 not found: ID does not exist"
Jul 10 19:31:57.499174 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:57.499154    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"]
Jul 10 19:31:57.500559 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:57.500542    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-4b29b-7b79559756-thmqw"]
Jul 10 19:31:59.122541 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:31:59.122512    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c41ebd47-f76f-488e-bd5b-6858d15638d9" path="/var/lib/kubelet/pods/c41ebd47-f76f-488e-bd5b-6858d15638d9/volumes"
Jul 10 19:32:26.905473 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:26.905435    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"]
Jul 10 19:32:26.905969 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:26.905892    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c41ebd47-f76f-488e-bd5b-6858d15638d9" containerName="splitter-graph-4b29b"
Jul 10 19:32:26.905969 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:26.905910    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c41ebd47-f76f-488e-bd5b-6858d15638d9" containerName="splitter-graph-4b29b"
Jul 10 19:32:26.906099 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:26.906007    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c41ebd47-f76f-488e-bd5b-6858d15638d9" containerName="splitter-graph-4b29b"
Jul 10 19:32:26.908298 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:26.908270    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:32:26.908907 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:26.908894    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:32:26.911332 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:26.911309    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-1e1e7-kube-rbac-proxy-sar-config\""
Jul 10 19:32:26.911480 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:26.911319    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-1e1e7-serving-cert\""
Jul 10 19:32:26.919949 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:26.919929    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"]
Jul 10 19:32:27.044999 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.044971    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:32:27.083182 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.083153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a935b160-e3a6-483d-85c8-55fd2500d0af-openshift-service-ca-bundle\") pod \"splitter-graph-1e1e7-5cd9fb55-x5p4n\" (UID: \"a935b160-e3a6-483d-85c8-55fd2500d0af\") " pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:32:27.083310 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.083202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a935b160-e3a6-483d-85c8-55fd2500d0af-proxy-tls\") pod \"splitter-graph-1e1e7-5cd9fb55-x5p4n\" (UID: \"a935b160-e3a6-483d-85c8-55fd2500d0af\") " pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:32:27.184119 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.184062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a935b160-e3a6-483d-85c8-55fd2500d0af-openshift-service-ca-bundle\") pod \"splitter-graph-1e1e7-5cd9fb55-x5p4n\" (UID: \"a935b160-e3a6-483d-85c8-55fd2500d0af\") " pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:32:27.184119 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.184099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a935b160-e3a6-483d-85c8-55fd2500d0af-proxy-tls\") pod \"splitter-graph-1e1e7-5cd9fb55-x5p4n\" (UID: \"a935b160-e3a6-483d-85c8-55fd2500d0af\") " pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:32:27.184777 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.184757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a935b160-e3a6-483d-85c8-55fd2500d0af-openshift-service-ca-bundle\") pod \"splitter-graph-1e1e7-5cd9fb55-x5p4n\" (UID: \"a935b160-e3a6-483d-85c8-55fd2500d0af\") " pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:32:27.186432 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.186411    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a935b160-e3a6-483d-85c8-55fd2500d0af-proxy-tls\") pod \"splitter-graph-1e1e7-5cd9fb55-x5p4n\" (UID: \"a935b160-e3a6-483d-85c8-55fd2500d0af\") " pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:32:27.218376 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.218351    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:32:27.341494 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.341473    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"]
Jul 10 19:32:27.343546 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:32:27.343516    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda935b160_e3a6_483d_85c8_55fd2500d0af.slice/crio-0fb60cd8623ff350c26e7a8f7c7002323f619d62078c86bef1d3efb594a8d965 WatchSource:0}: Error finding container 0fb60cd8623ff350c26e7a8f7c7002323f619d62078c86bef1d3efb594a8d965: Status 404 returned error can't find the container with id 0fb60cd8623ff350c26e7a8f7c7002323f619d62078c86bef1d3efb594a8d965
Jul 10 19:32:27.608773 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.608694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" event={"ID":"a935b160-e3a6-483d-85c8-55fd2500d0af","Type":"ContainerStarted","Data":"1002e39dff6e29d83afeede9ebdf11aa7b45abf066df8316f509983d2ce8c21b"}
Jul 10 19:32:27.608773 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.608743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" event={"ID":"a935b160-e3a6-483d-85c8-55fd2500d0af","Type":"ContainerStarted","Data":"0fb60cd8623ff350c26e7a8f7c7002323f619d62078c86bef1d3efb594a8d965"}
Jul 10 19:32:27.608773 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.608770    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:32:27.624488 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:27.624446    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" podStartSLOduration=1.6244300360000001 podStartE2EDuration="1.624430036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 19:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:32:27.623672963 +0000 UTC m=+2047.080223351" watchObservedRunningTime="2026-07-10 19:32:27.624430036 +0000 UTC m=+2047.080980414"
Jul 10 19:32:33.618544 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:32:33.618511    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:33:21.042337 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:33:21.042311    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:33:21.044873 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:33:21.044575    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:33:21.046573 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:33:21.046556    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:33:21.048961 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:33:21.048946    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:34:12.232922 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:34:12.232890    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:35:12.364316 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:35:12.364279    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:36:19.789288 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:36:19.789214    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:36:19.865217 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:36:19.865187    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:38:21.067021 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:38:21.066928    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:38:21.070024 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:38:21.070004    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:38:21.071468 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:38:21.071448    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:38:21.074652 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:38:21.074635    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:40:41.460573 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:40:41.460531    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"]
Jul 10 19:40:41.461073 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:40:41.460779    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" podUID="a935b160-e3a6-483d-85c8-55fd2500d0af" containerName="splitter-graph-1e1e7" containerID="cri-o://1002e39dff6e29d83afeede9ebdf11aa7b45abf066df8316f509983d2ce8c21b" gracePeriod=30
Jul 10 19:40:41.520745 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:40:41.520716    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:40:43.091040 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:40:43.091006    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:40:43.616948 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:40:43.616913    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" podUID="a935b160-e3a6-483d-85c8-55fd2500d0af" containerName="splitter-graph-1e1e7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:40:48.617088 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:40:48.617053    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" podUID="a935b160-e3a6-483d-85c8-55fd2500d0af" containerName="splitter-graph-1e1e7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:40:53.617052 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:40:53.617015    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" podUID="a935b160-e3a6-483d-85c8-55fd2500d0af" containerName="splitter-graph-1e1e7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:40:53.617416 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:40:53.617123    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:40:54.641861 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:40:54.641824    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:40:58.617757 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:40:58.617718    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" podUID="a935b160-e3a6-483d-85c8-55fd2500d0af" containerName="splitter-graph-1e1e7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:41:03.617569 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:03.617528    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" podUID="a935b160-e3a6-483d-85c8-55fd2500d0af" containerName="splitter-graph-1e1e7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:41:08.617345 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:08.617303    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" podUID="a935b160-e3a6-483d-85c8-55fd2500d0af" containerName="splitter-graph-1e1e7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:41:11.764456 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:11.764359    2579 generic.go:356] "Generic (PLEG): container finished" podID="a935b160-e3a6-483d-85c8-55fd2500d0af" containerID="1002e39dff6e29d83afeede9ebdf11aa7b45abf066df8316f509983d2ce8c21b" exitCode=0
Jul 10 19:41:11.764456 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:11.764434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" event={"ID":"a935b160-e3a6-483d-85c8-55fd2500d0af","Type":"ContainerDied","Data":"1002e39dff6e29d83afeede9ebdf11aa7b45abf066df8316f509983d2ce8c21b"}
Jul 10 19:41:12.103591 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.103568    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:41:12.149472 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.149449    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a935b160-e3a6-483d-85c8-55fd2500d0af-proxy-tls\") pod \"a935b160-e3a6-483d-85c8-55fd2500d0af\" (UID: \"a935b160-e3a6-483d-85c8-55fd2500d0af\") "
Jul 10 19:41:12.149616 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.149521    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a935b160-e3a6-483d-85c8-55fd2500d0af-openshift-service-ca-bundle\") pod \"a935b160-e3a6-483d-85c8-55fd2500d0af\" (UID: \"a935b160-e3a6-483d-85c8-55fd2500d0af\") "
Jul 10 19:41:12.149851 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.149826    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a935b160-e3a6-483d-85c8-55fd2500d0af-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a935b160-e3a6-483d-85c8-55fd2500d0af" (UID: "a935b160-e3a6-483d-85c8-55fd2500d0af"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:41:12.151460 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.151435    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a935b160-e3a6-483d-85c8-55fd2500d0af-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a935b160-e3a6-483d-85c8-55fd2500d0af" (UID: "a935b160-e3a6-483d-85c8-55fd2500d0af"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:41:12.250129 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.250108    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a935b160-e3a6-483d-85c8-55fd2500d0af-openshift-service-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:41:12.250129 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.250130    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a935b160-e3a6-483d-85c8-55fd2500d0af-proxy-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:41:12.769347 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.769323    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"
Jul 10 19:41:12.769814 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.769378    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n" event={"ID":"a935b160-e3a6-483d-85c8-55fd2500d0af","Type":"ContainerDied","Data":"0fb60cd8623ff350c26e7a8f7c7002323f619d62078c86bef1d3efb594a8d965"}
Jul 10 19:41:12.769814 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.769436    2579 scope.go:117] "RemoveContainer" containerID="1002e39dff6e29d83afeede9ebdf11aa7b45abf066df8316f509983d2ce8c21b"
Jul 10 19:41:12.789233 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.789207    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"]
Jul 10 19:41:12.793148 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:12.793128    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-1e1e7-5cd9fb55-x5p4n"]
Jul 10 19:41:13.122490 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:41:13.122464    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a935b160-e3a6-483d-85c8-55fd2500d0af" path="/var/lib/kubelet/pods/a935b160-e3a6-483d-85c8-55fd2500d0af/volumes"
Jul 10 19:42:03.457546 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:42:03.457514    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:43:21.092408 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:43:21.092272    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:43:21.095497 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:43:21.095350    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:43:21.096527 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:43:21.096508    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:43:21.099879 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:43:21.099863    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:47:33.774675 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:47:33.774642    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:48:01.829046 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:01.828955    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"]
Jul 10 19:48:01.829512 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:01.829187    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" podUID="3c791eec-7293-4aba-83b9-5391cc1ecb15" containerName="switch-graph-1c787" containerID="cri-o://3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4" gracePeriod=30
Jul 10 19:48:01.846323 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:01.846275    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:48:01.972633 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:01.972598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:48:02.045398 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:02.045355    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:48:02.902085 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:02.902056    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:48:02.959244 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:02.959215    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:48:04.426773 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:04.426733    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" podUID="3c791eec-7293-4aba-83b9-5391cc1ecb15" containerName="switch-graph-1c787" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:48:09.425662 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:09.425626    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" podUID="3c791eec-7293-4aba-83b9-5391cc1ecb15" containerName="switch-graph-1c787" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:48:14.426106 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:14.426062    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" podUID="3c791eec-7293-4aba-83b9-5391cc1ecb15" containerName="switch-graph-1c787" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:48:14.426479 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:14.426176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:48:17.708438 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:17.708406    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:18.501800 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:18.501775    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:19.299244 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:19.299214    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:19.425984 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:19.425949    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" podUID="3c791eec-7293-4aba-83b9-5391cc1ecb15" containerName="switch-graph-1c787" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:48:20.060795 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:20.060771    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:20.820886 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:20.820861    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:21.116383 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:21.116228    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:48:21.121464 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:21.121309    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:48:21.121678 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:21.121665    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:48:21.125968 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:21.125952    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:48:21.597934 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:21.597907    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:22.345941 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:22.345908    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:23.109523 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:23.109491    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:23.872643 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:23.872618    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:24.426093 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:24.426057    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" podUID="3c791eec-7293-4aba-83b9-5391cc1ecb15" containerName="switch-graph-1c787" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:48:24.696399 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:24.696312    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:25.481783 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:25.481759    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:26.292784 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:26.292756    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:27.104683 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:27.104658    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:27.915874 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:27.915848    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-1c787-7d48d4c4f9-bzp49_3c791eec-7293-4aba-83b9-5391cc1ecb15/switch-graph-1c787/0.log"
Jul 10 19:48:29.426321 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:29.426288    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" podUID="3c791eec-7293-4aba-83b9-5391cc1ecb15" containerName="switch-graph-1c787" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 19:48:30.185017 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:30.184983    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:48:30.243550 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:30.243519    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:48:31.973573 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:31.973551    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:48:32.059211 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.059184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c791eec-7293-4aba-83b9-5391cc1ecb15-openshift-service-ca-bundle\") pod \"3c791eec-7293-4aba-83b9-5391cc1ecb15\" (UID: \"3c791eec-7293-4aba-83b9-5391cc1ecb15\") "
Jul 10 19:48:32.059365 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.059266    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c791eec-7293-4aba-83b9-5391cc1ecb15-proxy-tls\") pod \"3c791eec-7293-4aba-83b9-5391cc1ecb15\" (UID: \"3c791eec-7293-4aba-83b9-5391cc1ecb15\") "
Jul 10 19:48:32.059579 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.059551    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c791eec-7293-4aba-83b9-5391cc1ecb15-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "3c791eec-7293-4aba-83b9-5391cc1ecb15" (UID: "3c791eec-7293-4aba-83b9-5391cc1ecb15"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 19:48:32.061111 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.061088    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c791eec-7293-4aba-83b9-5391cc1ecb15-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3c791eec-7293-4aba-83b9-5391cc1ecb15" (UID: "3c791eec-7293-4aba-83b9-5391cc1ecb15"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 19:48:32.160227 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.160205    2579 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3c791eec-7293-4aba-83b9-5391cc1ecb15-proxy-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:48:32.160227 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.160225    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c791eec-7293-4aba-83b9-5391cc1ecb15-openshift-service-ca-bundle\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Jul 10 19:48:32.540745 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.540665    2579 generic.go:356] "Generic (PLEG): container finished" podID="3c791eec-7293-4aba-83b9-5391cc1ecb15" containerID="3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4" exitCode=0
Jul 10 19:48:32.540745 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.540710    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"
Jul 10 19:48:32.540745 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.540727    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" event={"ID":"3c791eec-7293-4aba-83b9-5391cc1ecb15","Type":"ContainerDied","Data":"3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4"}
Jul 10 19:48:32.540993 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.540779    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49" event={"ID":"3c791eec-7293-4aba-83b9-5391cc1ecb15","Type":"ContainerDied","Data":"ad058eaa3b6ee7b2b5a273e750074d67ab8940649a32974c2dcc054276e5854d"}
Jul 10 19:48:32.540993 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.540808    2579 scope.go:117] "RemoveContainer" containerID="3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4"
Jul 10 19:48:32.548894 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.548878    2579 scope.go:117] "RemoveContainer" containerID="3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4"
Jul 10 19:48:32.549128 ip-10-0-131-123 kubenswrapper[2579]: E0710 19:48:32.549113    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4\": container with ID starting with 3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4 not found: ID does not exist" containerID="3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4"
Jul 10 19:48:32.549170 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.549135    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4"} err="failed to get container status \"3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4\": rpc error: code = NotFound desc = could not find container \"3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4\": container with ID starting with 3bf1dd5b9cc3a353a05fc6d7953a1817bb1b17cf12a3f7cc30abbecce3e684a4 not found: ID does not exist"
Jul 10 19:48:32.560438 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.560415    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"]
Jul 10 19:48:32.563796 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.563777    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-1c787-7d48d4c4f9-bzp49"]
Jul 10 19:48:32.760994 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.760973    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xxrhq_b2bb328d-1bb7-4f64-a0e2-5f2dd89ecf85/global-pull-secret-syncer/0.log"
Jul 10 19:48:32.856757 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.856705    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log"
Jul 10 19:48:32.953678 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:32.953660    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-123.ec2.internal_852848d9a6955f404681b7955865ce86/haproxy/0.log"
Jul 10 19:48:33.122417 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:33.122391    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c791eec-7293-4aba-83b9-5391cc1ecb15" path="/var/lib/kubelet/pods/3c791eec-7293-4aba-83b9-5391cc1ecb15/volumes"
Jul 10 19:48:35.697140 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:35.697106    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:48:35.758987 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:35.758958    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5snc_d1e17b26-f350-4ea8-b77d-d3b5737f033d/konnectivity-agent/0.log" limit=1024
Jul 10 19:48:37.162849 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:37.162824    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-f64sw_2e85202e-30a4-40e6-8c88-d046b5db0c33/kube-state-metrics/0.log"
Jul 10 19:48:37.186729 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:37.186704    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-f64sw_2e85202e-30a4-40e6-8c88-d046b5db0c33/kube-rbac-proxy-main/0.log"
Jul 10 19:48:37.213567 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:37.213547    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-f64sw_2e85202e-30a4-40e6-8c88-d046b5db0c33/kube-rbac-proxy-self/0.log"
Jul 10 19:48:37.413605 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:37.413515    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k5vrp_d801d62b-f25d-4dc9-bd05-d04d2a83ca9a/node-exporter/0.log"
Jul 10 19:48:37.438813 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:37.438791    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k5vrp_d801d62b-f25d-4dc9-bd05-d04d2a83ca9a/kube-rbac-proxy/0.log"
Jul 10 19:48:37.461346 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:37.461325    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k5vrp_d801d62b-f25d-4dc9-bd05-d04d2a83ca9a/init-textfile/0.log"
Jul 10 19:48:37.977156 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:37.977134    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-dgl6b_3c358503-152f-4fc4-8738-a5206c71af1a/prometheus-operator/0.log"
Jul 10 19:48:38.016915 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:38.016893    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-dgl6b_3c358503-152f-4fc4-8738-a5206c71af1a/kube-rbac-proxy/0.log"
Jul 10 19:48:38.049226 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:38.049208    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-lgp7w_2a1ede2a-937b-4ecf-88e1-31f33dde4ada/prometheus-operator-admission-webhook/0.log"
Jul 10 19:48:40.091841 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.091816    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/1.log"
Jul 10 19:48:40.097647 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.097625    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-67btj_15852620-efcb-48e1-bf17-6073adc16659/console-operator/2.log"
Jul 10 19:48:40.503066 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.503041    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-vxfjr_bf49778f-47da-41d3-986b-fc2a08ad48e7/download-server/0.log"
Jul 10 19:48:40.849841 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.849768    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"]
Jul 10 19:48:40.850105 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.850093    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a935b160-e3a6-483d-85c8-55fd2500d0af" containerName="splitter-graph-1e1e7"
Jul 10 19:48:40.850150 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.850107    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a935b160-e3a6-483d-85c8-55fd2500d0af" containerName="splitter-graph-1e1e7"
Jul 10 19:48:40.850150 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.850134    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c791eec-7293-4aba-83b9-5391cc1ecb15" containerName="switch-graph-1c787"
Jul 10 19:48:40.850150 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.850139    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c791eec-7293-4aba-83b9-5391cc1ecb15" containerName="switch-graph-1c787"
Jul 10 19:48:40.850323 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.850194    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c791eec-7293-4aba-83b9-5391cc1ecb15" containerName="switch-graph-1c787"
Jul 10 19:48:40.850323 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.850203    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a935b160-e3a6-483d-85c8-55fd2500d0af" containerName="splitter-graph-1e1e7"
Jul 10 19:48:40.854552 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.854537    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:40.857254 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.857005    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fqzzt\"/\"kube-root-ca.crt\""
Jul 10 19:48:40.857254 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.857041    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fqzzt\"/\"default-dockercfg-vr2dg\""
Jul 10 19:48:40.858057 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.858033    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fqzzt\"/\"openshift-service-ca.crt\""
Jul 10 19:48:40.862941 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.862921    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"]
Jul 10 19:48:40.929933 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.929898    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-proc\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:40.929933 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.929928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-lib-modules\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:40.930094 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.929955    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-podres\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:40.930094 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.929983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-sys\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:40.930094 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:40.930024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbsmv\" (UniqueName: \"kubernetes.io/projected/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-kube-api-access-xbsmv\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.030931 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.030909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-proc\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.031019 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.030938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-lib-modules\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.031019 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.030964    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-podres\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.031019 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.030990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-sys\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.031135 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.031028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-proc\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.031135 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.031035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbsmv\" (UniqueName: \"kubernetes.io/projected/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-kube-api-access-xbsmv\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.031135 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.031081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-podres\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.031135 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.031088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-lib-modules\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.031135 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.031100    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-sys\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.033983 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.033966    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-44g66_485642a5-8099-4fd0-810e-4dd570b455e6/volume-data-source-validator/0.log"
Jul 10 19:48:41.038644 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.038616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbsmv\" (UniqueName: \"kubernetes.io/projected/aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8-kube-api-access-xbsmv\") pod \"perf-node-gather-daemonset-cc5x4\" (UID: \"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8\") " pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.164342 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.164321    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.289126 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.289099    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"]
Jul 10 19:48:41.292094 ip-10-0-131-123 kubenswrapper[2579]: W0710 19:48:41.292064    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaefd0e14_ac6f_4ef5_9a6e_05e50df9cea8.slice/crio-8c17e053da8ea478f37fb8623d5df3ddc86fefb1d396bdffe08376150353d97f WatchSource:0}: Error finding container 8c17e053da8ea478f37fb8623d5df3ddc86fefb1d396bdffe08376150353d97f: Status 404 returned error can't find the container with id 8c17e053da8ea478f37fb8623d5df3ddc86fefb1d396bdffe08376150353d97f
Jul 10 19:48:41.578453 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.578357    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4" event={"ID":"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8","Type":"ContainerStarted","Data":"4f3feed2cb9e27354d9d9a933c1065afe879171762a0694ecf3cdd7fd5cc4b70"}
Jul 10 19:48:41.578453 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.578431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4" event={"ID":"aefd0e14-ac6f-4ef5-9a6e-05e50df9cea8","Type":"ContainerStarted","Data":"8c17e053da8ea478f37fb8623d5df3ddc86fefb1d396bdffe08376150353d97f"}
Jul 10 19:48:41.578661 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.578479    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:41.596078 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:41.596035    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4" podStartSLOduration=1.5960219979999999 podStartE2EDuration="1.596021998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 19:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 19:48:41.594297787 +0000 UTC m=+3021.050848164" watchObservedRunningTime="2026-07-10 19:48:41.596021998 +0000 UTC m=+3021.052572378"
Jul 10 19:48:42.072641 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:42.072613    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7bqv_e979646e-840e-4a43-8aff-705dbdc1f116/dns/0.log"
Jul 10 19:48:42.099943 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:42.099922    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7bqv_e979646e-840e-4a43-8aff-705dbdc1f116/kube-rbac-proxy/0.log"
Jul 10 19:48:42.190901 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:42.190884    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4g9f_7387df1d-ca1e-43e5-8092-9dc2a2e00328/dns-node-resolver/0.log"
Jul 10 19:48:42.674877 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:42.674852    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-575dcb8698-5sssc_1c4e86ad-dc68-4191-8867-3f99be4adb48/registry/0.log"
Jul 10 19:48:42.756838 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:42.756809    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zwmdv_84297d76-89dd-4b8f-96a2-07271e721443/node-ca/0.log"
Jul 10 19:48:43.583757 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:43.583732    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b8f9f9c6d-5bl7h_fe60350d-1703-4cd7-b18a-deca0ffe4d54/router/0.log"
Jul 10 19:48:43.930226 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:43.930188    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nb85_10f54178-163e-47c9-8a23-586879ffa3ba/serve-healthcheck-canary/0.log"
Jul 10 19:48:44.318300 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:44.318231    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-87c77_58cdd02c-fa04-4d34-9e93-ef6619456821/insights-operator/0.log"
Jul 10 19:48:44.318851 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:44.318836    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-87c77_58cdd02c-fa04-4d34-9e93-ef6619456821/insights-operator/1.log"
Jul 10 19:48:44.341280 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:44.341256    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5bfbm_fa064662-d006-4909-b0d9-39f99b2bbd38/kube-rbac-proxy/0.log"
Jul 10 19:48:44.362245 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:44.362227    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5bfbm_fa064662-d006-4909-b0d9-39f99b2bbd38/exporter/0.log"
Jul 10 19:48:44.385384 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:44.385334    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5bfbm_fa064662-d006-4909-b0d9-39f99b2bbd38/extractor/0.log"
Jul 10 19:48:46.560922 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:46.560896    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-69f6979966-l9w8m_e4ed9c30-aa43-4552-b939-e45e130a4714/manager/0.log"
Jul 10 19:48:46.582499 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:46.582475    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-dmsl9_8a5d9c9f-1e82-458e-b43e-18d46060c768/manager/0.log"
Jul 10 19:48:47.591451 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:47.591418    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fqzzt/perf-node-gather-daemonset-cc5x4"
Jul 10 19:48:52.677968 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:52.677944    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8xnz_4095efea-3030-4f10-878d-02894f3fa560/kube-multus-additional-cni-plugins/0.log"
Jul 10 19:48:52.714110 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:52.714089    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8xnz_4095efea-3030-4f10-878d-02894f3fa560/egress-router-binary-copy/0.log"
Jul 10 19:48:52.744228 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:52.744204    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8xnz_4095efea-3030-4f10-878d-02894f3fa560/cni-plugins/0.log"
Jul 10 19:48:52.769405 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:52.769388    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8xnz_4095efea-3030-4f10-878d-02894f3fa560/bond-cni-plugin/0.log"
Jul 10 19:48:52.798426 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:52.798403    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8xnz_4095efea-3030-4f10-878d-02894f3fa560/routeoverride-cni/0.log"
Jul 10 19:48:52.820273 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:52.820251    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8xnz_4095efea-3030-4f10-878d-02894f3fa560/whereabouts-cni-bincopy/0.log"
Jul 10 19:48:52.844128 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:52.844109    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8xnz_4095efea-3030-4f10-878d-02894f3fa560/whereabouts-cni/0.log"
Jul 10 19:48:53.423336 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:53.423288    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c9glj_fba4c91f-93c0-48ed-afa2-82d46cf48965/kube-multus/0.log"
Jul 10 19:48:53.716092 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:53.716025    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w6cw9_03c8f640-6992-4fac-8c1d-802baf0a69d4/network-metrics-daemon/0.log"
Jul 10 19:48:53.766446 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:53.766423    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w6cw9_03c8f640-6992-4fac-8c1d-802baf0a69d4/kube-rbac-proxy/0.log"
Jul 10 19:48:55.259764 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:55.259734    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-controller/0.log"
Jul 10 19:48:55.284161 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:55.284136    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/0.log"
Jul 10 19:48:55.284280 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:55.284182    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovn-acl-logging/1.log"
Jul 10 19:48:55.316696 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:55.316678    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/kube-rbac-proxy-node/0.log"
Jul 10 19:48:55.352748 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:55.352726    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/kube-rbac-proxy-ovn-metrics/0.log"
Jul 10 19:48:55.380445 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:55.380425    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/northd/0.log"
Jul 10 19:48:55.404725 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:55.404703    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/nbdb/0.log"
Jul 10 19:48:55.429656 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:55.429642    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/sbdb/0.log"
Jul 10 19:48:55.478601 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:55.478583    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qs4gh_ce8d7b43-bcf9-495a-9b4b-503fb697e8e5/ovnkube-controller/0.log"
Jul 10 19:48:56.710897 ip-10-0-131-123 kubenswrapper[2579]: I0710 19:48:56.710871    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-sl68j_c230e79e-35d4-49e0-b95c-1c994f296ba5/network-check-target-container/0.log"