Jul 30 03:34:44.748530 ip-10-0-136-241 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 03:34:45.109991 ip-10-0-136-241 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 03:34:45.109991 ip-10-0-136-241 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 03:34:45.109991 ip-10-0-136-241 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 03:34:45.109991 ip-10-0-136-241 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 03:34:45.109991 ip-10-0-136-241 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 03:34:45.112120 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.112003    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 03:34:45.117665 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117647    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 03:34:45.117665 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117665    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117670    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117674    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117677    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117680    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117683    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117686    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117689    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117692    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117695    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117697    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117700    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117703    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117706    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117708    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117711    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117715    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117723    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117725    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117728    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 03:34:45.117735 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117731    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117733    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117736    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117739    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117742    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117745    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117747    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117750    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117753    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117756    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117758    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117761    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117764    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117766    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117769    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117771    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117774    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117777    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117779    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 03:34:45.118225 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117781    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117784    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117787    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117790    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117792    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117795    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117798    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117803    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117807    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117811    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117813    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117817    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117820    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117823    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117826    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117829    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117832    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117835    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117837    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 03:34:45.118680 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117840    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117842    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117845    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117847    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117850    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117853    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117855    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117858    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117860    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117863    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117865    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117867    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117870    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117873    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117876    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117878    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117881    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117883    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117886    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117889    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 03:34:45.119184 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117891    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117893    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117896    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117898    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117901    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117905    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117910    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117915    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117918    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117921    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117924    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117928    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117930    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117933    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117935    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117938    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117941    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117943    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117952    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 03:34:45.119777 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.117956    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118658    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118664    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118667    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118670    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118673    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118676    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118679    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118682    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118685    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118688    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118691    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118694    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118697    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118700    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118703    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118705    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118709    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118712    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118715    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 03:34:45.120254 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118718    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118723    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118726    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118730    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118732    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118737    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118741    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118744    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118747    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118750    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118753    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118757    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118761    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118764    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118767    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118773    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118775    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118778    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118781    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 03:34:45.120739 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118784    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118787    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118789    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118792    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118795    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118797    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118800    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118803    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118805    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118808    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118811    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118814    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118816    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118819    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118822    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118825    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118827    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118830    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118833    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118836    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 03:34:45.121233 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118838    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118840    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118843    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118845    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118848    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118851    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118853    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118856    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118860    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118863    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118866    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118868    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118871    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118874    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118876    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118879    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118881    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118884    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118886    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118889    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 03:34:45.121732 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118891    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118894    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118897    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118899    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118902    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118904    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118907    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118910    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118912    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118915    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118917    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118920    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118922    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118925    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118927    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118930    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118932    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118934    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118937    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 03:34:45.122244 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118939    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.118943    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119337    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119342    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119345    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119348    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119358    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119361    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119364    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119367    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119369    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119372    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119375    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119377    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119380    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119383    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119386    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119389    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119391    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 03:34:45.122709 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119394    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119397    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119399    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119402    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119405    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119407    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119410    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119412    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119415    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119418    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119420    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119423    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119425    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119428    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119432    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119435    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119437    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119440    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119442    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 03:34:45.123170 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119445    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119451    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119454    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119456    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119459    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119461    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119464    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119466    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119469    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119472    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119475    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119477    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119480    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119483    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119486    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119489    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119491    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119494    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119497    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119499    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 03:34:45.123642 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119503    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119506    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119509    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119512    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119515    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119518    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119521    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119525    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119528    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119530    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119533    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119536    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119538    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119541    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119547    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119549    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119552    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119554    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119557    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119559    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119561    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 03:34:45.124158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119564    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119567    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119569    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119573    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119577    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119580    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119583    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119586    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119589    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119592    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119594    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119597    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119600    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119602    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119605    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119608    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119610    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119616    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119620    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 03:34:45.124686 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119622    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119625    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.119628    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119694    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119701    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119707    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119711    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119716    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119720    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119724    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119728    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119731    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119734    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119738    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119741    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119744    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119747    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119750    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119753    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119756    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119759    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119763    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119766    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119769    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 03:34:45.125151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119772    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119776    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119780    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119783    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119786    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119790    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119794    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119797    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119800    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119803    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119806    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119810    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119814    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119817    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119820    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119823    2571 flags.go:64] FLAG: --enable-server="true"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119827    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119831    2571 flags.go:64] FLAG: --event-burst="100"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119834    2571 flags.go:64] FLAG: --event-qps="50"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119837    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119840    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119843    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119847    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119850    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119852    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 03:34:45.125743 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119856    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119859    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119861    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119864    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119867    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119870    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119873    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119876    2571 flags.go:64] FLAG: --feature-gates=""
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119879    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119883    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119886    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119889    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119892    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119896    2571 flags.go:64] FLAG: --help="false"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119899    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-136-241.ec2.internal"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119902    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119905    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119908    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119911    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119915    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119918    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119921    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119924    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 03:34:45.126371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119927    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119930    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119933    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119936    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119939    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119942    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119945    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119948    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119951    2571 flags.go:64] FLAG: --lock-file=""
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119954    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119957    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119960    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119965    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119968    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119971    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119974    2571 flags.go:64] FLAG: --logging-format="text"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119976    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119980    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119982    2571 flags.go:64] FLAG: --manifest-url=""
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119985    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119989    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119992    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.119997    2571 flags.go:64] FLAG: --max-pods="110"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120000    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120004    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 03:34:45.126974 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120006    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120009    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120012    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120015    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120018    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120025    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120028    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120031    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120034    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120038    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120043    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120046    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120049    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120052    2571 flags.go:64] FLAG: --port="10250"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120055    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120058    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07bc09a87a6a0d6fb"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120061    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120064    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120068    2571 flags.go:64] FLAG: --register-node="true"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120071    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120074    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120077    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120080    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120082    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120087    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 03:34:45.127648 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120090    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120093    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120095    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120098    2571 flags.go:64] FLAG: --runonce="false"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120102    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120106    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120109    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120112    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120115    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120118    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120121    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120124    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120127    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120130    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120133    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120136    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120139    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120143    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120146    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120151    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120154    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120156    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120161    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120163    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120166    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 03:34:45.128288 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120169    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120172    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120174    2571 flags.go:64] FLAG: --v="2"
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120179    2571 flags.go:64] FLAG: --version="false"
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120182    2571 flags.go:64] FLAG: --vmodule=""
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120186    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.120204    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120376    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120381    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120384    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120387    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120392    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120395    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120398    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120401    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120403    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120405    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120409    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120411    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120414    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120416    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 03:34:45.128889 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120419    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120421    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120424    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120426    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120430    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120432    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120435    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120438    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120441    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120443    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120446    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120450    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120453    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120456    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120459    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120461    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120464    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120466    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120469    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 03:34:45.129422 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120471    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120474    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120476    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120481    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120484    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120486    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120489    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120492    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120494    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120497    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120500    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120502    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120505    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120507    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120510    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120512    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120515    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120518    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120521    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120523    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 03:34:45.129881 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120526    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120528    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120531    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120533    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120536    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120539    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120541    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120543    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120546    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120549    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120551    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120554    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120556    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120558    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120561    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120565    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120568    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120570    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120573    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120575    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 03:34:45.130402 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120578    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120580    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120583    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120586    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120589    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120593    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120597    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120600    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120602    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120605    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120608    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120611    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120613    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120616    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120618    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120621    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120624    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120626    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120629    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 03:34:45.131006 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120631    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120634    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120637    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120639    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120642    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120644    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.120648    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.121157    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.128179    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.128211    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.128233    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.128239    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128311    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128316    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 03:34:45.131508 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128319    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128322    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128325    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128328    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128331    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128334    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128337    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128340    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128343    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128345    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128349    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128352    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128354    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128357    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128360    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128364    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128367    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128371    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128375    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 03:34:45.132034 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128379    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128384    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128388    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128391    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128394    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128397    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128400    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128403    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128407    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128410    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128413    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128416    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128418    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128421    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128423    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128426    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128429    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128432    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128436    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 03:34:45.132677 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128440    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128443    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128445    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128448    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128451    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128454    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128457    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128459    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128462    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128464    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128467    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128469    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128472    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128474    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128477    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128479    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128481    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128484    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128487    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128489    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 03:34:45.133164 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128492    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128495    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128498    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128501    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128503    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128506    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128509    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128512    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128515    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128517    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128520    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128524    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128528    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128531    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128534    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128537    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128539    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128542    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128545    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 03:34:45.133708 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128548    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128551    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128554    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128556    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128559    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128561    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128564    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128566    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128569    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128571    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128574    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128576    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128579    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128582    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128585    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128587    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128590    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128593    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128595    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 03:34:45.134188 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128598    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.128603    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128719    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128728    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128731    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128733    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128736    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128738    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128741    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128743    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128746    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128749    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128751    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128755    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128758    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 03:34:45.134890 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128760    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128764    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128766    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128769    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128771    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128774    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128777    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128779    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128781    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128785    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128787    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128790    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128792    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128795    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128798    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128801    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128803    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128806    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128808    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128811    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 03:34:45.135300 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128813    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128816    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128819    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128821    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128824    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128826    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128828    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128831    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128834    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128838    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128841    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128845    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128848    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128850    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128853    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128856    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128859    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128862    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128865    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128867    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 03:34:45.136053 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128870    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128872    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128875    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128877    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128880    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128882    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128885    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128887    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128890    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128893    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128895    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128898    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128901    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128903    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128906    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128909    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128911    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128914    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128916    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 03:34:45.136825 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128919    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128922    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128924    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128927    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128929    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128932    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128935    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128937    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128939    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128942    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128944    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128947    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128949    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128952    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128954    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128957    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128959    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128962    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128965    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128967    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 03:34:45.137329 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128969    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128974    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128977    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128982    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128985    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128988    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:45.128990    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.128996    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.129106    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.133127    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.134419    2571 server.go:1019] "Starting client certificate rotation"
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.134532    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.134574    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 03:34:45.137966 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.137015    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 03:34:45.138352 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.138185    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 03:34:45.149530 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.149508    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 30 03:34:45.151761 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.151745    2571 log.go:25] "Validated CRI v1 image API"
Jul 30 03:34:45.152629 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.152616    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 03:34:45.154872 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.154847    2571 fs.go:135] Filesystem UUIDs: map[023c0822-1028-4389-bee0-5ce5451e98d6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9fde05cb-5908-4466-a5be-e2b805df27a0:/dev/nvme0n1p4]
Jul 30 03:34:45.154943 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.154871    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 03:34:45.159777 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.159665    2571 manager.go:216] Machine: {Timestamp:2026-07-30 03:34:45.158510374 +0000 UTC m=+0.304752928 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098577 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22022feb8770f2dffe782bffb5296d SystemUUID:ec22022f-eb87-70f2-dffe-782bffb5296d BootID:22143c23-dd22-4124-81d8-32a880ac4f3a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:1d:aa:b5:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:1d:aa:b5:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:b7:a0:08:75:0d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 03:34:45.159777 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.159768    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 03:34:45.159899 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.159884    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 03:34:45.162708 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.162676    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 03:34:45.162779 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.162746    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 03:34:45.162888 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.162710    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-241.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 03:34:45.163443 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.163431    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 03:34:45.163494 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.163450    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 03:34:45.163494 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.163461    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 03:34:45.164090 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.164078    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 03:34:45.165837 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.165824    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 03:34:45.168475 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.168462    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 03:34:45.168614 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.168603    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 03:34:45.168669 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.168643    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 03:34:45.168669 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.168658    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 03:34:45.168768 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.168677    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 03:34:45.168768 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.168690    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 30 03:34:45.168768 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.168703    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 03:34:45.169071 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.169057    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 03:34:45.169130 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.169080    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 03:34:45.172092 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.171840    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 03:34:45.173494 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.173463    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 03:34:45.173559 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.173512    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 03:34:45.174160 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174147    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 03:34:45.174211 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174171    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 03:34:45.174211 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174181    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 03:34:45.174211 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174189    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 03:34:45.174292 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174212    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 03:34:45.174292 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174218    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 03:34:45.174292 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174226    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 03:34:45.174292 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174232    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 03:34:45.174292 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174239    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 03:34:45.174292 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174244    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 03:34:45.174292 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174252    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 03:34:45.174292 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174257    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 03:34:45.174867 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174857    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 03:34:45.174867 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.174866    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 03:34:45.178104 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.178089    2571 server.go:1268] "Started kubelet"
Jul 30 03:34:45.178303 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.178286    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-241.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 03:34:45.178412 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.178388    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 03:34:45.178468 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:45.178434    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 03:34:45.178468 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:45.178434    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 03:34:45.179500 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.179445    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 03:34:45.179583 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.179508    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 03:34:45.180178 ip-10-0-136-241 systemd[1]: Started Kubernetes Kubelet.
Jul 30 03:34:45.181085 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.181071    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 03:34:45.181669 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.181656    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 03:34:45.184240 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:45.183233    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-241.ec2.internal.18c6f3e9313e0ce1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-241.ec2.internal,UID:ip-10-0-136-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-241.ec2.internal,},FirstTimestamp:2026-07-30 03:34:45.178060001 +0000 UTC m=+0.324302556,LastTimestamp:2026-07-30 03:34:45.178060001 +0000 UTC m=+0.324302556,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-241.ec2.internal,}"
Jul 30 03:34:45.184541 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:45.184525    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 03:34:45.189518 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.189504    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 03:34:45.189598 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.189581    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 03:34:45.189653 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:45.189599    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:45.190176 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190158    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 03:34:45.190176 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190166    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 03:34:45.190176 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190177    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 03:34:45.190385 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190277    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 03:34:45.190385 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190289    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 03:34:45.190480 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190387    2571 factory.go:55] Registering systemd factory
Jul 30 03:34:45.190480 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190404    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 30 03:34:45.190656 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190626    2571 factory.go:153] Registering CRI-O factory
Jul 30 03:34:45.190656 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190642    2571 factory.go:223] Registration of the crio container factory successfully
Jul 30 03:34:45.190830 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190691    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 03:34:45.190830 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190715    2571 factory.go:103] Registering Raw factory
Jul 30 03:34:45.190830 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.190729    2571 manager.go:1196] Started watching for new ooms in manager
Jul 30 03:34:45.191683 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:45.191262    2571 manager.go:349] Starting recovery of all containers
Jul 30 03:34:46.509389 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.509365    2571 manager.go:354] Recovery completed
Jul 30 03:34:46.510456 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.510412    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 03:34:46.510607 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.510568    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 03:34:46.511568 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.511519    2571 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 30 03:34:46.514752 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.514737    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 03:34:46.517578 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.517555    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 03:34:46.517640 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.517591    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 03:34:46.517640 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.517602    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientPID"
Jul 30 03:34:46.518126 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.518108    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 03:34:46.518126 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.518123    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 03:34:46.518237 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.518131    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 03:34:46.518237 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.518139    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 03:34:46.519007 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.518991    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 03:34:46.519087 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.519024    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 03:34:46.519087 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.519039    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientPID"
Jul 30 03:34:46.519187 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.519174    2571 policy_none.go:49] "None policy: Start"
Jul 30 03:34:46.519234 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.519191    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 03:34:46.519234 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.519203    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 03:34:46.519802 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.519788    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-smwd7"
Jul 30 03:34:46.520324 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.520314    2571 policy_none.go:47] "Start"
Jul 30 03:34:46.527506 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.527480    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-smwd7"
Jul 30 03:34:46.529859 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.529787    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-241.ec2.internal.18c6f3e98115768f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-241.ec2.internal,UID:ip-10-0-136-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-241.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-241.ec2.internal,},FirstTimestamp:2026-07-30 03:34:46.517577359 +0000 UTC m=+0.356484638,LastTimestamp:2026-07-30 03:34:46.517577359 +0000 UTC m=+0.356484638,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-241.ec2.internal,}"
Jul 30 03:34:46.564393 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.564207    2571 manager.go:337] "Starting Device Plugin manager"
Jul 30 03:34:46.564546 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.564417    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 03:34:46.564546 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.564432    2571 server.go:87] "Starting device plugin registration server"
Jul 30 03:34:46.564785 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.564770    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 03:34:46.564876 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.564786    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 03:34:46.564923 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.564889    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 03:34:46.564991 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.564978    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 03:34:46.565036 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.564991    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 03:34:46.565468 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.565450    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 03:34:46.565554 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.565505    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:46.633582 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.633536    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 03:34:46.634783 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.634733    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 03:34:46.634783 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.634779    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 03:34:46.634862 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.634812    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 03:34:46.634862 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.634857    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 03:34:46.636873 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.636855    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 03:34:46.665502 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.665455    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 03:34:46.666442 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.666426    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 03:34:46.666549 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.666459    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 03:34:46.666549 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.666472    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientPID"
Jul 30 03:34:46.666549 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.666504    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.675209 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.675137    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.675209 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.675163    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-241.ec2.internal\": node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:46.700462 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.700427    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:46.735420 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.735393    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-241.ec2.internal"]
Jul 30 03:34:46.735582 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.735466    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 03:34:46.736918 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.736903    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 03:34:46.737001 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.736936    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 03:34:46.737001 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.736950    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientPID"
Jul 30 03:34:46.738341 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.738325    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 03:34:46.738441 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.738426    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.738488 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.738457    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 03:34:46.741276 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.741258    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 03:34:46.741374 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.741293    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 03:34:46.741374 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.741309    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientPID"
Jul 30 03:34:46.741374 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.741335    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 03:34:46.741374 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.741355    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 03:34:46.741374 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.741364    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientPID"
Jul 30 03:34:46.742443 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.742430    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.742488 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.742453    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 03:34:46.743818 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.743803    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 03:34:46.743894 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.743828    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 03:34:46.743894 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.743838    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientPID"
Jul 30 03:34:46.763138 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.763119    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-241.ec2.internal\" not found" node="ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.766756 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.766738    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-241.ec2.internal\" not found" node="ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.798951 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.798922    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97fa05860d6558195780c1b46f6bb901-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal\" (UID: \"97fa05860d6558195780c1b46f6bb901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.798951 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.798952    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97fa05860d6558195780c1b46f6bb901-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal\" (UID: \"97fa05860d6558195780c1b46f6bb901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.799133 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.798983    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6436331a3fffddc9a43cdb229905c3b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-241.ec2.internal\" (UID: \"d6436331a3fffddc9a43cdb229905c3b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.801015 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.800998    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:46.899813 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.899772    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97fa05860d6558195780c1b46f6bb901-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal\" (UID: \"97fa05860d6558195780c1b46f6bb901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.899813 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.899815    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97fa05860d6558195780c1b46f6bb901-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal\" (UID: \"97fa05860d6558195780c1b46f6bb901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.899938 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.899832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6436331a3fffddc9a43cdb229905c3b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-241.ec2.internal\" (UID: \"d6436331a3fffddc9a43cdb229905c3b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.899938 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.899873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97fa05860d6558195780c1b46f6bb901-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal\" (UID: \"97fa05860d6558195780c1b46f6bb901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.899938 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.899888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d6436331a3fffddc9a43cdb229905c3b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-241.ec2.internal\" (UID: \"d6436331a3fffddc9a43cdb229905c3b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.899938 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:46.899873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97fa05860d6558195780c1b46f6bb901-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal\" (UID: \"97fa05860d6558195780c1b46f6bb901\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:46.901885 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:46.901866    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:47.002770 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:47.002701    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:47.065919 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.065891    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:47.071278 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.071260    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:47.103669 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:47.103633    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:47.204151 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:47.204112    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:47.304767 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:47.304698    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:47.405322 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:47.405292    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:47.441480 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.441449    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 03:34:47.441971 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.441630    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 03:34:47.505625 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:47.505584    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:47.531983 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.531947    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 03:29:46 +0000 UTC" deadline="2027-12-23 15:08:07.271119774 +0000 UTC"
Jul 30 03:34:47.531983 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.531978    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12275h33m19.739144978s"
Jul 30 03:34:47.544099 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.544073    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 03:34:47.545385 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.545364    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 03:34:47.545488 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.545400    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 03:34:47.545488 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.545412    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeHasSufficientPID"
Jul 30 03:34:47.563998 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:47.563938    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6436331a3fffddc9a43cdb229905c3b.slice/crio-22376bb8cf057a7816d9d6a1e17b58a329d5414485d16b4ce4942bafbd3faa19 WatchSource:0}: Error finding container 22376bb8cf057a7816d9d6a1e17b58a329d5414485d16b4ce4942bafbd3faa19: Status 404 returned error can't find the container with id 22376bb8cf057a7816d9d6a1e17b58a329d5414485d16b4ce4942bafbd3faa19
Jul 30 03:34:47.569303 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.569280    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 03:34:47.605902 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:47.605871    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:47.638336 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.638287    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-241.ec2.internal" event={"ID":"d6436331a3fffddc9a43cdb229905c3b","Type":"ContainerStarted","Data":"22376bb8cf057a7816d9d6a1e17b58a329d5414485d16b4ce4942bafbd3faa19"}
Jul 30 03:34:47.658103 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:47.658063    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fa05860d6558195780c1b46f6bb901.slice/crio-c224cf6cfbd24e59dbef3cfa1df6450c1972a46cf593e3738d579ae14633310e WatchSource:0}: Error finding container c224cf6cfbd24e59dbef3cfa1df6450c1972a46cf593e3738d579ae14633310e: Status 404 returned error can't find the container with id c224cf6cfbd24e59dbef3cfa1df6450c1972a46cf593e3738d579ae14633310e
Jul 30 03:34:47.706540 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:47.706504    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:47.807007 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:47.806971    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:47.907583 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:47.907553    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:47.949507 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:47.949476    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 03:34:48.008613 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.008583    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-241.ec2.internal\" not found"
Jul 30 03:34:48.055546 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.055502    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 03:34:48.089355 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.089325    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 03:34:48.097504 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.097477    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:48.110282 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.110258    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 03:34:48.111387 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.111358    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-241.ec2.internal"
Jul 30 03:34:48.121510 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.121443    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 03:34:48.477689 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.477662    2571 apiserver.go:52] "Watching apiserver"
Jul 30 03:34:48.484335 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.484312    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 03:34:48.484824 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.484800    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-twskj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal","openshift-multus/network-metrics-daemon-9tdmg","openshift-network-operator/iptables-alerter-ptgkx","kube-system/konnectivity-agent-w22qn","openshift-image-registry/node-ca-82j8x","openshift-multus/multus-additional-cni-plugins-2tn52","openshift-multus/multus-zzb4g","openshift-network-diagnostics/network-check-target-cd4wm","openshift-ovn-kubernetes/ovnkube-node-k6tl9","kube-system/global-pull-secret-syncer-h6twk","kube-system/kube-apiserver-proxy-ip-10-0-136-241.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5","openshift-cluster-node-tuning-operator/tuned-ggf25"]
Jul 30 03:34:48.486888 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.486636    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.487889 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.487867    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.489063 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.489042    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:48.489154 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.489128    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:34:48.489384 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.489361    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 03:34:48.489458 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.489415    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 03:34:48.489569 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.489550    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 03:34:48.489659 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.489593    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 03:34:48.489659 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.489643    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-spxkq\""
Jul 30 03:34:48.489659 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.489563    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 03:34:48.489849 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.489833    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 03:34:48.490034 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.490014    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 03:34:48.490126 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.490104    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rkfsc\""
Jul 30 03:34:48.490397 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.490377    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 03:34:48.490468 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.490388    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-twskj"
Jul 30 03:34:48.491931 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.491800    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:34:48.493010 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.492992    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-82j8x"
Jul 30 03:34:48.493514 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.493492    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 03:34:48.493668 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.493517    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 03:34:48.493668 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.493492    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nl4nf\""
Jul 30 03:34:48.494330 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.494171    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vx6rm\""
Jul 30 03:34:48.494330 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.494237    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 03:34:48.494330 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.494260    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 03:34:48.494838 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.494788    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.495323 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.495303    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 03:34:48.495545 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.495513    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8dk44\""
Jul 30 03:34:48.495735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.495719    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 03:34:48.495931 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.495915    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 03:34:48.496545 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.496507    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.497613 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.497151    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 03:34:48.497613 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.497397    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 03:34:48.497746 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.497623    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zllnd\""
Jul 30 03:34:48.497746 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.497730    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 03:34:48.497746 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.497740    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 03:34:48.498750 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.498736    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 03:34:48.500471 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.500452    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-knrzr\""
Jul 30 03:34:48.500638 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.498974    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 03:34:48.500866 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.498892    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 03:34:48.501142 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.500269    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 03:34:48.501690 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.501673    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ptgkx"
Jul 30 03:34:48.505237 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.504835    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 03:34:48.505237 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.504939    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 03:34:48.505237 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.504977    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wt5kt\""
Jul 30 03:34:48.505237 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.505089    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 03:34:48.507704 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.507071    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:48.507990 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.507824    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:34:48.507990 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.507892    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:48.507990 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.507955    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:34:48.508882 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.508861    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 03:34:48.509371 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509350    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.509781 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509355    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-modprobe-d\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.509781 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509517    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-sysctl-conf\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.509781 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509562    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-host\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.509781 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509589    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-etc-selinux\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.509781 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509615    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-var-lib-cni-bin\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.509781 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509644    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-daemon-config\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.509781 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509668    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-log-socket\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.509781 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509694    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-sysctl-d\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.509781 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509727    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-tuned\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.509781 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-node-log\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.509781 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509780    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-sys\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509823    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-run-netns\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509856    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-var-lib-kubelet\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-run-multus-certs\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509945    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-run-netns\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.509982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-cni-bin\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510006    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrkcg\" (UniqueName: \"kubernetes.io/projected/2e9e7985-57b1-4487-9907-6c9d98c2ed29-kube-api-access-vrkcg\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510038    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/551297f1-e510-43c5-a973-a242b44b4576-konnectivity-ca\") pod \"konnectivity-agent-w22qn\" (UID: \"551297f1-e510-43c5-a973-a242b44b4576\") " pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510062    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64pqq\" (UniqueName: \"kubernetes.io/projected/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-kube-api-access-64pqq\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510084    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c75t6\" (UniqueName: \"kubernetes.io/projected/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-kube-api-access-c75t6\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510114    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-slash\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510136    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-run-ovn\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510160    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e9e7985-57b1-4487-9907-6c9d98c2ed29-env-overrides\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e9e7985-57b1-4487-9907-6c9d98c2ed29-ovn-node-metrics-cert\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510206    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-sysconfig\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510228    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-kubernetes\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.510353 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510283    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-lib-modules\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.511119 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.510375    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-socket-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.512046 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.511713    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-os-release\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.512658 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.511736    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 03:34:48.512658 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.511741    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 03:34:48.512658 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-run-k8s-cni-cncf-io\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.512658 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512377    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-device-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.512658 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.511792    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5pq5v\""
Jul 30 03:34:48.512658 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512402    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-system-cni-dir\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.512658 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512429    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-socket-dir-parent\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.512658 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512466    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb9sn\" (UniqueName: \"kubernetes.io/projected/04984729-931b-4439-a61d-690b9d4ef7d5-kube-api-access-wb9sn\") pod \"iptables-alerter-ptgkx\" (UID: \"04984729-931b-4439-a61d-690b9d4ef7d5\") " pod="openshift-network-operator/iptables-alerter-ptgkx"
Jul 30 03:34:48.512658 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512489    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-run-ovn-kubernetes\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512792    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjzcm\" (UniqueName: \"kubernetes.io/projected/06734eec-1df6-46d2-806d-9c83d5ee5f6b-kube-api-access-rjzcm\") pod \"node-ca-82j8x\" (UID: \"06734eec-1df6-46d2-806d-9c83d5ee5f6b\") " pod="openshift-image-registry/node-ca-82j8x"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512821    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-etc-kubernetes\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512844    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04984729-931b-4439-a61d-690b9d4ef7d5-iptables-alerter-script\") pod \"iptables-alerter-ptgkx\" (UID: \"04984729-931b-4439-a61d-690b9d4ef7d5\") " pod="openshift-network-operator/iptables-alerter-ptgkx"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512867    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e9e7985-57b1-4487-9907-6c9d98c2ed29-ovnkube-config\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512891    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab-hosts-file\") pod \"node-resolver-twskj\" (UID: \"79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab\") " pod="openshift-dns/node-resolver-twskj"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512916    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06734eec-1df6-46d2-806d-9c83d5ee5f6b-serviceca\") pod \"node-ca-82j8x\" (UID: \"06734eec-1df6-46d2-806d-9c83d5ee5f6b\") " pod="openshift-image-registry/node-ca-82j8x"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512939    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-systemd-units\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab-tmp-dir\") pod \"node-resolver-twskj\" (UID: \"79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab\") " pod="openshift-dns/node-resolver-twskj"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.512985    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513011    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q576\" (UniqueName: \"kubernetes.io/projected/79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab-kube-api-access-6q576\") pod \"node-resolver-twskj\" (UID: \"79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab\") " pod="openshift-dns/node-resolver-twskj"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513042    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513066    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-cni-binary-copy\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513088    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-hostroot\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513109    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04984729-931b-4439-a61d-690b9d4ef7d5-host-slash\") pod \"iptables-alerter-ptgkx\" (UID: \"04984729-931b-4439-a61d-690b9d4ef7d5\") " pod="openshift-network-operator/iptables-alerter-ptgkx"
Jul 30 03:34:48.513156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513150    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-etc-openvswitch\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.513840 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e9e7985-57b1-4487-9907-6c9d98c2ed29-ovnkube-script-lib\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.513840 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513207    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f6wv\" (UniqueName: \"kubernetes.io/projected/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-kube-api-access-7f6wv\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:48.513840 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513230    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-systemd\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.513840 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513261    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e35b41a4-9137-4299-941d-ad6515eb5f89-tmp\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.513840 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513306    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-cni-dir\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.514587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.513330    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-run-openvswitch\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.514587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514386    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzt4g\" (UniqueName: \"kubernetes.io/projected/e35b41a4-9137-4299-941d-ad6515eb5f89-kube-api-access-pzt4g\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.514587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514424    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:48.514587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514447    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/551297f1-e510-43c5-a973-a242b44b4576-agent-certs\") pod \"konnectivity-agent-w22qn\" (UID: \"551297f1-e510-43c5-a973-a242b44b4576\") " pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:34:48.514587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514471    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-var-lib-cni-multus\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.514587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514497    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-conf-dir\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.514587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-run-systemd\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.514587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514575    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-cni-netd\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.515308 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514604    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-run\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.515308 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-var-lib-kubelet\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.515308 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514647    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06734eec-1df6-46d2-806d-9c83d5ee5f6b-host\") pod \"node-ca-82j8x\" (UID: \"06734eec-1df6-46d2-806d-9c83d5ee5f6b\") " pod="openshift-image-registry/node-ca-82j8x"
Jul 30 03:34:48.515308 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514669    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-cnibin\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.515308 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-kubelet\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.515308 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514717    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-registration-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.515308 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514748    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-sys-fs\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.515308 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.514778    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-var-lib-openvswitch\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.541483 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.541458    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gp9zs"
Jul 30 03:34:48.550100 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.550072    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gp9zs"
Jul 30 03:34:48.599263 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.599234    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 03:34:48.615541 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615495    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx6hg\" (UniqueName: \"kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg\") pod \"network-check-target-cd4wm\" (UID: \"52337e3e-c603-4f04-afa7-285827f0bb25\") " pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:48.615703 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615555    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjzcm\" (UniqueName: \"kubernetes.io/projected/06734eec-1df6-46d2-806d-9c83d5ee5f6b-kube-api-access-rjzcm\") pod \"node-ca-82j8x\" (UID: \"06734eec-1df6-46d2-806d-9c83d5ee5f6b\") " pod="openshift-image-registry/node-ca-82j8x"
Jul 30 03:34:48.615703 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615585    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-etc-kubernetes\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.615703 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615605    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04984729-931b-4439-a61d-690b9d4ef7d5-iptables-alerter-script\") pod \"iptables-alerter-ptgkx\" (UID: \"04984729-931b-4439-a61d-690b9d4ef7d5\") " pod="openshift-network-operator/iptables-alerter-ptgkx"
Jul 30 03:34:48.615703 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e9e7985-57b1-4487-9907-6c9d98c2ed29-ovnkube-config\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.615703 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615654    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab-hosts-file\") pod \"node-resolver-twskj\" (UID: \"79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab\") " pod="openshift-dns/node-resolver-twskj"
Jul 30 03:34:48.615703 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615672    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06734eec-1df6-46d2-806d-9c83d5ee5f6b-serviceca\") pod \"node-ca-82j8x\" (UID: \"06734eec-1df6-46d2-806d-9c83d5ee5f6b\") " pod="openshift-image-registry/node-ca-82j8x"
Jul 30 03:34:48.615703 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615688    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615712    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-systemd-units\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615720    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-etc-kubernetes\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab-tmp-dir\") pod \"node-resolver-twskj\" (UID: \"79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab\") " pod="openshift-dns/node-resolver-twskj"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615782    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615824    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-cni-binary-copy\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615850    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q576\" (UniqueName: \"kubernetes.io/projected/79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab-kube-api-access-6q576\") pod \"node-resolver-twskj\" (UID: \"79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab\") " pod="openshift-dns/node-resolver-twskj"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615855    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab-hosts-file\") pod \"node-resolver-twskj\" (UID: \"79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab\") " pod="openshift-dns/node-resolver-twskj"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615923    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-cni-binary-copy\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615946    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-hostroot\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615969    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04984729-931b-4439-a61d-690b9d4ef7d5-host-slash\") pod \"iptables-alerter-ptgkx\" (UID: \"04984729-931b-4439-a61d-690b9d4ef7d5\") " pod="openshift-network-operator/iptables-alerter-ptgkx"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.615990    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-etc-openvswitch\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.616047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e9e7985-57b1-4487-9907-6c9d98c2ed29-ovnkube-script-lib\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616065    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f6wv\" (UniqueName: \"kubernetes.io/projected/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-kube-api-access-7f6wv\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-cnibin\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-os-release\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616215    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-systemd\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616236    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e35b41a4-9137-4299-941d-ad6515eb5f89-tmp\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616258    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-cni-dir\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616283    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-run-openvswitch\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616307    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzt4g\" (UniqueName: \"kubernetes.io/projected/e35b41a4-9137-4299-941d-ad6515eb5f89-kube-api-access-pzt4g\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616313    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06734eec-1df6-46d2-806d-9c83d5ee5f6b-serviceca\") pod \"node-ca-82j8x\" (UID: \"06734eec-1df6-46d2-806d-9c83d5ee5f6b\") " pod="openshift-image-registry/node-ca-82j8x"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616361    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/551297f1-e510-43c5-a973-a242b44b4576-agent-certs\") pod \"konnectivity-agent-w22qn\" (UID: \"551297f1-e510-43c5-a973-a242b44b4576\") " pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616387    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-var-lib-cni-multus\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616389    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e9e7985-57b1-4487-9907-6c9d98c2ed29-ovnkube-config\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616411    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-conf-dir\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616451    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-conf-dir\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.616676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616452    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-run-systemd\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616493    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-cni-netd\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616522    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b07ce16c-1a8d-452d-b97e-8048abd8d86a-dbus\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616571    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-run\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616599    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-var-lib-kubelet\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06734eec-1df6-46d2-806d-9c83d5ee5f6b-host\") pod \"node-ca-82j8x\" (UID: \"06734eec-1df6-46d2-806d-9c83d5ee5f6b\") " pod="openshift-image-registry/node-ca-82j8x"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616671    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-cnibin\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616694    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-kubelet\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616727    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-system-cni-dir\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616759    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-registration-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616818    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab-tmp-dir\") pod \"node-resolver-twskj\" (UID: \"79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab\") " pod="openshift-dns/node-resolver-twskj"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616820    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-sys-fs\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616889    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-sys-fs\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616907    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-var-lib-openvswitch\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-modprobe-d\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616982    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-sysctl-conf\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.617481 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-host\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-run-openvswitch\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-etc-selinux\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617066    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617089    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-var-lib-cni-bin\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617096    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-systemd\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-var-lib-cni-bin\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617159    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-daemon-config\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-log-socket\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-sysctl-d\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617235    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-tuned\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-node-log\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617296    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b07ce16c-1a8d-452d-b97e-8048abd8d86a-kubelet-config\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617325    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-sys\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617361    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-run-netns\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617395    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-var-lib-kubelet\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617407    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 03:34:48.618269 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617420    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-run-multus-certs\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617426    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04984729-931b-4439-a61d-690b9d4ef7d5-iptables-alerter-script\") pod \"iptables-alerter-ptgkx\" (UID: \"04984729-931b-4439-a61d-690b9d4ef7d5\") " pod="openshift-network-operator/iptables-alerter-ptgkx"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617446    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-run-netns\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617472    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-cni-bin\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617497    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrkcg\" (UniqueName: \"kubernetes.io/projected/2e9e7985-57b1-4487-9907-6c9d98c2ed29-kube-api-access-vrkcg\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617547    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/551297f1-e510-43c5-a973-a242b44b4576-konnectivity-ca\") pod \"konnectivity-agent-w22qn\" (UID: \"551297f1-e510-43c5-a973-a242b44b4576\") " pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617573    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64pqq\" (UniqueName: \"kubernetes.io/projected/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-kube-api-access-64pqq\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617600    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c75t6\" (UniqueName: \"kubernetes.io/projected/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-kube-api-access-c75t6\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617628    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-slash\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617634    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-cni-netd\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.616495    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-systemd-units\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617654    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-run-ovn\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617683    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e9e7985-57b1-4487-9907-6c9d98c2ed29-env-overrides\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617707    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e9e7985-57b1-4487-9907-6c9d98c2ed29-ovn-node-metrics-cert\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617733    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-sysconfig\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617755    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-kubernetes\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617776    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-lib-modules\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.619114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617782    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-run\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617790    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-sys\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617797    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-socket-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-os-release\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617831    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-var-lib-kubelet\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-run-k8s-cni-cncf-io\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617829    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-sysctl-conf\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617869    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-var-lib-cni-multus\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617882    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06734eec-1df6-46d2-806d-9c83d5ee5f6b-host\") pod \"node-ca-82j8x\" (UID: \"06734eec-1df6-46d2-806d-9c83d5ee5f6b\") " pod="openshift-image-registry/node-ca-82j8x"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617871    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617918    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-device-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617930    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-cnibin\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-system-cni-dir\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617934    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-run-netns\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617966    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-socket-dir-parent\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618001    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-var-lib-kubelet\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618010    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-socket-dir-parent\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.618011    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:34:48.619886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618028    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb9sn\" (UniqueName: \"kubernetes.io/projected/04984729-931b-4439-a61d-690b9d4ef7d5-kube-api-access-wb9sn\") pod \"iptables-alerter-ptgkx\" (UID: \"04984729-931b-4439-a61d-690b9d4ef7d5\") " pod="openshift-network-operator/iptables-alerter-ptgkx"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618043    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-kubelet\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-run-ovn-kubernetes\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.618079    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs podName:b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359 nodeName:}" failed. No retries permitted until 2026-07-30 03:34:49.118060787 +0000 UTC m=+2.956968071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs") pod "network-metrics-daemon-9tdmg" (UID: "b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618089    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-run-ovn-kubernetes\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618108    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-var-lib-openvswitch\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618127    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-registration-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618146    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-run-netns\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618180    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-run-multus-certs\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618194    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-modprobe-d\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618235    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-cni-bin\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618279    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-device-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618325    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-system-cni-dir\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618411    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-host\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618515    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-cni-dir\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618540    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppczr\" (UniqueName: \"kubernetes.io/projected/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-kube-api-access-ppczr\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618552    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-log-socket\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.620735 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618556    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04984729-931b-4439-a61d-690b9d4ef7d5-host-slash\") pod \"iptables-alerter-ptgkx\" (UID: \"04984729-931b-4439-a61d-690b9d4ef7d5\") " pod="openshift-network-operator/iptables-alerter-ptgkx"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618611    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-hostroot\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618683    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-etc-selinux\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618692    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-socket-dir\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618687    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-sysctl-d\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618725    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-node-log\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-sysconfig\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618785    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-host-run-k8s-cni-cncf-io\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618843    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-os-release\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.617600    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-run-systemd\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.618963    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/551297f1-e510-43c5-a973-a242b44b4576-konnectivity-ca\") pod \"konnectivity-agent-w22qn\" (UID: \"551297f1-e510-43c5-a973-a242b44b4576\") " pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.619001    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-cni-binary-copy\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.619057    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-host-slash\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.619135    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-kubernetes\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.619268    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e9e7985-57b1-4487-9907-6c9d98c2ed29-ovnkube-script-lib\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.619291    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e35b41a4-9137-4299-941d-ad6515eb5f89-lib-modules\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.619328    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-etc-openvswitch\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.619362    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e9e7985-57b1-4487-9907-6c9d98c2ed29-run-ovn\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.621587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.619441    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e9e7985-57b1-4487-9907-6c9d98c2ed29-env-overrides\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.622360 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.619988    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-multus-daemon-config\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.622360 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.622022    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e35b41a4-9137-4299-941d-ad6515eb5f89-etc-tuned\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.622360 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.622042    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e35b41a4-9137-4299-941d-ad6515eb5f89-tmp\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.622360 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.622300    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e9e7985-57b1-4487-9907-6c9d98c2ed29-ovn-node-metrics-cert\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.622520 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.622429    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/551297f1-e510-43c5-a973-a242b44b4576-agent-certs\") pod \"konnectivity-agent-w22qn\" (UID: \"551297f1-e510-43c5-a973-a242b44b4576\") " pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:34:48.625602 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.624936    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q576\" (UniqueName: \"kubernetes.io/projected/79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab-kube-api-access-6q576\") pod \"node-resolver-twskj\" (UID: \"79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab\") " pod="openshift-dns/node-resolver-twskj"
Jul 30 03:34:48.626013 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.625987    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjzcm\" (UniqueName: \"kubernetes.io/projected/06734eec-1df6-46d2-806d-9c83d5ee5f6b-kube-api-access-rjzcm\") pod \"node-ca-82j8x\" (UID: \"06734eec-1df6-46d2-806d-9c83d5ee5f6b\") " pod="openshift-image-registry/node-ca-82j8x"
Jul 30 03:34:48.626292 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.626239    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f6wv\" (UniqueName: \"kubernetes.io/projected/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-kube-api-access-7f6wv\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:48.628093 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.627353    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrkcg\" (UniqueName: \"kubernetes.io/projected/2e9e7985-57b1-4487-9907-6c9d98c2ed29-kube-api-access-vrkcg\") pod \"ovnkube-node-k6tl9\" (UID: \"2e9e7985-57b1-4487-9907-6c9d98c2ed29\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.629452 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.629420    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c75t6\" (UniqueName: \"kubernetes.io/projected/fa3af588-c3d4-4a7e-a59e-6a17b155dcfe-kube-api-access-c75t6\") pod \"multus-zzb4g\" (UID: \"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe\") " pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.629851 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.629792    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb9sn\" (UniqueName: \"kubernetes.io/projected/04984729-931b-4439-a61d-690b9d4ef7d5-kube-api-access-wb9sn\") pod \"iptables-alerter-ptgkx\" (UID: \"04984729-931b-4439-a61d-690b9d4ef7d5\") " pod="openshift-network-operator/iptables-alerter-ptgkx"
Jul 30 03:34:48.630506 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.630483    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64pqq\" (UniqueName: \"kubernetes.io/projected/9e1db8ad-0566-40c8-bde9-587fd6fd9e90-kube-api-access-64pqq\") pod \"aws-ebs-csi-driver-node-pm7p5\" (UID: \"9e1db8ad-0566-40c8-bde9-587fd6fd9e90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.632014 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.631995    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzt4g\" (UniqueName: \"kubernetes.io/projected/e35b41a4-9137-4299-941d-ad6515eb5f89-kube-api-access-pzt4g\") pod \"tuned-ggf25\" (UID: \"e35b41a4-9137-4299-941d-ad6515eb5f89\") " pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.640478 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.640456    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal" event={"ID":"97fa05860d6558195780c1b46f6bb901","Type":"ContainerStarted","Data":"c224cf6cfbd24e59dbef3cfa1df6450c1972a46cf593e3738d579ae14633310e"}
Jul 30 03:34:48.642516 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.642501    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 03:34:48.719378 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719341    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-cni-binary-copy\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.719610 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719393    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:48.719610 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.719491    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 03:34:48.719610 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-cnibin\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.719610 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.719577    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret podName:b07ce16c-1a8d-452d-b97e-8048abd8d86a nodeName:}" failed. No retries permitted until 2026-07-30 03:34:49.219557923 +0000 UTC m=+3.058465194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret") pod "global-pull-secret-syncer-h6twk" (UID: "b07ce16c-1a8d-452d-b97e-8048abd8d86a") : object "kube-system"/"original-pull-secret" not registered
Jul 30 03:34:48.719610 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719594    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-cnibin\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.719610 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719606    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-os-release\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.719917 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719649    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b07ce16c-1a8d-452d-b97e-8048abd8d86a-dbus\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:48.719917 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719671    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-system-cni-dir\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.719917 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719697    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.719917 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719735    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b07ce16c-1a8d-452d-b97e-8048abd8d86a-kubelet-config\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:48.719917 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719760    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-os-release\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.719917 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719771    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b07ce16c-1a8d-452d-b97e-8048abd8d86a-dbus\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:48.719917 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719778    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.719917 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719805    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-system-cni-dir\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.719917 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719830    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b07ce16c-1a8d-452d-b97e-8048abd8d86a-kubelet-config\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:48.719917 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719833    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppczr\" (UniqueName: \"kubernetes.io/projected/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-kube-api-access-ppczr\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.720380 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719933    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.720380 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.719987    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6hg\" (UniqueName: \"kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg\") pod \"network-check-target-cd4wm\" (UID: \"52337e3e-c603-4f04-afa7-285827f0bb25\") " pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:48.720380 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.720022    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.720380 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.720098    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-cni-binary-copy\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.720380 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.720291    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.720661 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.720514    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.726576 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.726551    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 03:34:48.726576 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.726577    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 03:34:48.726777 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.726588    2571 projected.go:196] Error preparing data for projected volume kube-api-access-qx6hg for pod openshift-network-diagnostics/network-check-target-cd4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:34:48.726777 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:48.726693    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg podName:52337e3e-c603-4f04-afa7-285827f0bb25 nodeName:}" failed. No retries permitted until 2026-07-30 03:34:49.226673553 +0000 UTC m=+3.065580832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qx6hg" (UniqueName: "kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg") pod "network-check-target-cd4wm" (UID: "52337e3e-c603-4f04-afa7-285827f0bb25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:34:48.729144 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.729088    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppczr\" (UniqueName: \"kubernetes.io/projected/b8bd7c8d-4721-4074-8231-5cd9d1f8f254-kube-api-access-ppczr\") pod \"multus-additional-cni-plugins-2tn52\" (UID: \"b8bd7c8d-4721-4074-8231-5cd9d1f8f254\") " pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:48.801619 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.801587    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:34:48.809467 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.809444    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ggf25"
Jul 30 03:34:48.821761 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.821736    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-twskj"
Jul 30 03:34:48.826294 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.826268    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:34:48.833996 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.833978    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-82j8x"
Jul 30 03:34:48.841579 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.841561    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5"
Jul 30 03:34:48.849107 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.849090    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zzb4g"
Jul 30 03:34:48.857566 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.857544    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ptgkx"
Jul 30 03:34:48.863017 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:48.863001    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2tn52"
Jul 30 03:34:49.124009 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.123981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:49.124172 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:49.124119    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:34:49.124210 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:49.124176    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs podName:b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359 nodeName:}" failed. No retries permitted until 2026-07-30 03:34:50.124161908 +0000 UTC m=+3.963069180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs") pod "network-metrics-daemon-9tdmg" (UID: "b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:34:49.225424 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.224874    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:49.225424 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:49.225086    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 03:34:49.225424 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:49.225145    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret podName:b07ce16c-1a8d-452d-b97e-8048abd8d86a nodeName:}" failed. No retries permitted until 2026-07-30 03:34:50.225128631 +0000 UTC m=+4.064035898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret") pod "global-pull-secret-syncer-h6twk" (UID: "b07ce16c-1a8d-452d-b97e-8048abd8d86a") : object "kube-system"/"original-pull-secret" not registered
Jul 30 03:34:49.326203 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.326169    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6hg\" (UniqueName: \"kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg\") pod \"network-check-target-cd4wm\" (UID: \"52337e3e-c603-4f04-afa7-285827f0bb25\") " pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:49.326381 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:49.326360    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 03:34:49.326449 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:49.326386    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 03:34:49.326449 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:49.326396    2571 projected.go:196] Error preparing data for projected volume kube-api-access-qx6hg for pod openshift-network-diagnostics/network-check-target-cd4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:34:49.326515 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:49.326463    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg podName:52337e3e-c603-4f04-afa7-285827f0bb25 nodeName:}" failed. No retries permitted until 2026-07-30 03:34:50.326442867 +0000 UTC m=+4.165350155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx6hg" (UniqueName: "kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg") pod "network-check-target-cd4wm" (UID: "52337e3e-c603-4f04-afa7-285827f0bb25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:34:49.458058 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:49.457958    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9e7985_57b1_4487_9907_6c9d98c2ed29.slice/crio-60e4013b1434808d2ac25263229a4d8a58351e9fe7f53ccdcef0970763160f4f WatchSource:0}: Error finding container 60e4013b1434808d2ac25263229a4d8a58351e9fe7f53ccdcef0970763160f4f: Status 404 returned error can't find the container with id 60e4013b1434808d2ac25263229a4d8a58351e9fe7f53ccdcef0970763160f4f
Jul 30 03:34:49.459374 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:49.459349    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35b41a4_9137_4299_941d_ad6515eb5f89.slice/crio-e668403b1783bcdcd53a0ce17325940d51a389c0141e6799a4e91e510163bbc2 WatchSource:0}: Error finding container e668403b1783bcdcd53a0ce17325940d51a389c0141e6799a4e91e510163bbc2: Status 404 returned error can't find the container with id e668403b1783bcdcd53a0ce17325940d51a389c0141e6799a4e91e510163bbc2
Jul 30 03:34:49.464033 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:49.464013    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3af588_c3d4_4a7e_a59e_6a17b155dcfe.slice/crio-9439dfcdddd474009f6c5c0d02bf33f46ebc37ec5a3d9ed38d762e95ec4c2a78 WatchSource:0}: Error finding container 9439dfcdddd474009f6c5c0d02bf33f46ebc37ec5a3d9ed38d762e95ec4c2a78: Status 404 returned error can't find the container with id 9439dfcdddd474009f6c5c0d02bf33f46ebc37ec5a3d9ed38d762e95ec4c2a78
Jul 30 03:34:49.466570 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:49.466550    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06734eec_1df6_46d2_806d_9c83d5ee5f6b.slice/crio-d30b548865523316ba3da74103c130ec0410a2ac158e41e87dcf9193c4f07aae WatchSource:0}: Error finding container d30b548865523316ba3da74103c130ec0410a2ac158e41e87dcf9193c4f07aae: Status 404 returned error can't find the container with id d30b548865523316ba3da74103c130ec0410a2ac158e41e87dcf9193c4f07aae
Jul 30 03:34:49.467236 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:49.467213    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1db8ad_0566_40c8_bde9_587fd6fd9e90.slice/crio-d15b7358ea81cef269b00b459c2ee77da8f3682e475fdec7a6945f97e726287a WatchSource:0}: Error finding container d15b7358ea81cef269b00b459c2ee77da8f3682e475fdec7a6945f97e726287a: Status 404 returned error can't find the container with id d15b7358ea81cef269b00b459c2ee77da8f3682e475fdec7a6945f97e726287a
Jul 30 03:34:49.469095 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:49.468984    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8bd7c8d_4721_4074_8231_5cd9d1f8f254.slice/crio-57c47d053d789c7c033f404a6b92407b21401d4eefeb8a65cdcbef78dd90850f WatchSource:0}: Error finding container 57c47d053d789c7c033f404a6b92407b21401d4eefeb8a65cdcbef78dd90850f: Status 404 returned error can't find the container with id 57c47d053d789c7c033f404a6b92407b21401d4eefeb8a65cdcbef78dd90850f
Jul 30 03:34:49.469717 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:49.469684    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551297f1_e510_43c5_a973_a242b44b4576.slice/crio-44e34e10d3b571757795dce787748a69d8b5553b99461b50f8db062c020e2f77 WatchSource:0}: Error finding container 44e34e10d3b571757795dce787748a69d8b5553b99461b50f8db062c020e2f77: Status 404 returned error can't find the container with id 44e34e10d3b571757795dce787748a69d8b5553b99461b50f8db062c020e2f77
Jul 30 03:34:49.471049 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:49.471027    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d7f2dc_7fe3_4a4c_b979_22d22fbb15ab.slice/crio-b300231d665a36f045dcd877ad3fa8c924a8c54b09f52e2a72a65a00eaa0a31c WatchSource:0}: Error finding container b300231d665a36f045dcd877ad3fa8c924a8c54b09f52e2a72a65a00eaa0a31c: Status 404 returned error can't find the container with id b300231d665a36f045dcd877ad3fa8c924a8c54b09f52e2a72a65a00eaa0a31c
Jul 30 03:34:49.471943 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:34:49.471917    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04984729_931b_4439_a61d_690b9d4ef7d5.slice/crio-68dfd6f4453ef1533916e68048740951212c1929748636fe36e7ee95430cfe3b WatchSource:0}: Error finding container 68dfd6f4453ef1533916e68048740951212c1929748636fe36e7ee95430cfe3b: Status 404 returned error can't find the container with id 68dfd6f4453ef1533916e68048740951212c1929748636fe36e7ee95430cfe3b
Jul 30 03:34:49.551940 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.551894    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 03:29:48 +0000 UTC" deadline="2028-03-26 06:28:26.373755154 +0000 UTC"
Jul 30 03:34:49.551940 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.551937    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14522h53m36.821821632s"
Jul 30 03:34:49.636018 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.635986    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:49.636184 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:49.636090    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:34:49.643281 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.643253    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ggf25" event={"ID":"e35b41a4-9137-4299-941d-ad6515eb5f89","Type":"ContainerStarted","Data":"e668403b1783bcdcd53a0ce17325940d51a389c0141e6799a4e91e510163bbc2"}
Jul 30 03:34:49.644467 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.644437    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9" event={"ID":"2e9e7985-57b1-4487-9907-6c9d98c2ed29","Type":"ContainerStarted","Data":"60e4013b1434808d2ac25263229a4d8a58351e9fe7f53ccdcef0970763160f4f"}
Jul 30 03:34:49.646193 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.646164    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-241.ec2.internal" event={"ID":"d6436331a3fffddc9a43cdb229905c3b","Type":"ContainerStarted","Data":"10af9b3c220c7e434d1a1d472c0f58c53d9d14629d759b7961cc9a65aaf4bf66"}
Jul 30 03:34:49.647418 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.647389    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ptgkx" event={"ID":"04984729-931b-4439-a61d-690b9d4ef7d5","Type":"ContainerStarted","Data":"68dfd6f4453ef1533916e68048740951212c1929748636fe36e7ee95430cfe3b"}
Jul 30 03:34:49.648468 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.648448    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w22qn" event={"ID":"551297f1-e510-43c5-a973-a242b44b4576","Type":"ContainerStarted","Data":"44e34e10d3b571757795dce787748a69d8b5553b99461b50f8db062c020e2f77"}
Jul 30 03:34:49.649489 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.649469    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tn52" event={"ID":"b8bd7c8d-4721-4074-8231-5cd9d1f8f254","Type":"ContainerStarted","Data":"57c47d053d789c7c033f404a6b92407b21401d4eefeb8a65cdcbef78dd90850f"}
Jul 30 03:34:49.650579 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.650554    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-82j8x" event={"ID":"06734eec-1df6-46d2-806d-9c83d5ee5f6b","Type":"ContainerStarted","Data":"d30b548865523316ba3da74103c130ec0410a2ac158e41e87dcf9193c4f07aae"}
Jul 30 03:34:49.651424 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.651405    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5" event={"ID":"9e1db8ad-0566-40c8-bde9-587fd6fd9e90","Type":"ContainerStarted","Data":"d15b7358ea81cef269b00b459c2ee77da8f3682e475fdec7a6945f97e726287a"}
Jul 30 03:34:49.652344 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.652324    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zzb4g" event={"ID":"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe","Type":"ContainerStarted","Data":"9439dfcdddd474009f6c5c0d02bf33f46ebc37ec5a3d9ed38d762e95ec4c2a78"}
Jul 30 03:34:49.653203 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.653185    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-twskj" event={"ID":"79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab","Type":"ContainerStarted","Data":"b300231d665a36f045dcd877ad3fa8c924a8c54b09f52e2a72a65a00eaa0a31c"}
Jul 30 03:34:49.660978 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:49.660937    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-241.ec2.internal" podStartSLOduration=1.660924482 podStartE2EDuration="1.660924482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:34:49.660707595 +0000 UTC m=+3.499614881" watchObservedRunningTime="2026-07-30 03:34:49.660924482 +0000 UTC m=+3.499831766"
Jul 30 03:34:50.134973 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:50.134396    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:50.134973 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:50.134575    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:34:50.134973 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:50.134641    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs podName:b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359 nodeName:}" failed. No retries permitted until 2026-07-30 03:34:52.134620884 +0000 UTC m=+5.973528155 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs") pod "network-metrics-daemon-9tdmg" (UID: "b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:34:50.235492 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:50.235457    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:50.235691 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:50.235674    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 03:34:50.235758 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:50.235742    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret podName:b07ce16c-1a8d-452d-b97e-8048abd8d86a nodeName:}" failed. No retries permitted until 2026-07-30 03:34:52.235720497 +0000 UTC m=+6.074627767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret") pod "global-pull-secret-syncer-h6twk" (UID: "b07ce16c-1a8d-452d-b97e-8048abd8d86a") : object "kube-system"/"original-pull-secret" not registered
Jul 30 03:34:50.336561 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:50.336507    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6hg\" (UniqueName: \"kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg\") pod \"network-check-target-cd4wm\" (UID: \"52337e3e-c603-4f04-afa7-285827f0bb25\") " pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:50.336755 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:50.336740    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 03:34:50.336821 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:50.336759    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 03:34:50.336821 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:50.336772    2571 projected.go:196] Error preparing data for projected volume kube-api-access-qx6hg for pod openshift-network-diagnostics/network-check-target-cd4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:34:50.336960 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:50.336832    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg podName:52337e3e-c603-4f04-afa7-285827f0bb25 nodeName:}" failed. No retries permitted until 2026-07-30 03:34:52.336813926 +0000 UTC m=+6.175721194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx6hg" (UniqueName: "kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg") pod "network-check-target-cd4wm" (UID: "52337e3e-c603-4f04-afa7-285827f0bb25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:34:50.552376 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:50.552284    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 03:29:48 +0000 UTC" deadline="2028-02-15 16:34:29.229400157 +0000 UTC"
Jul 30 03:34:50.552376 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:50.552326    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13572h59m38.677078272s"
Jul 30 03:34:50.636745 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:50.636655    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:50.636745 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:50.636696    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:50.637041 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:50.636786    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:34:50.637280 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:50.637239    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:34:50.673297 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:50.672077    2571 generic.go:356] "Generic (PLEG): container finished" podID="97fa05860d6558195780c1b46f6bb901" containerID="6890d70e52febfa4457b790ab8221d281383fe011439d1858bcf733af0a0d960" exitCode=0
Jul 30 03:34:50.673297 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:50.673066    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal" event={"ID":"97fa05860d6558195780c1b46f6bb901","Type":"ContainerDied","Data":"6890d70e52febfa4457b790ab8221d281383fe011439d1858bcf733af0a0d960"}
Jul 30 03:34:51.635032 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:51.634998    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:51.635683 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:51.635159    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:34:51.694074 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:51.694037    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal" event={"ID":"97fa05860d6558195780c1b46f6bb901","Type":"ContainerStarted","Data":"b27b6c953c37573f8850ab8527f87ed5375875bd03b019ff9cb3dd48f7c587d1"}
Jul 30 03:34:52.149779 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:52.149731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:52.149960 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:52.149943    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:34:52.150045 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:52.150008    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs podName:b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359 nodeName:}" failed. No retries permitted until 2026-07-30 03:34:56.149988972 +0000 UTC m=+9.988896245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs") pod "network-metrics-daemon-9tdmg" (UID: "b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:34:52.250662 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:52.250624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:52.251232 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:52.251184    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 03:34:52.251368 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:52.251273    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret podName:b07ce16c-1a8d-452d-b97e-8048abd8d86a nodeName:}" failed. No retries permitted until 2026-07-30 03:34:56.251242603 +0000 UTC m=+10.090149872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret") pod "global-pull-secret-syncer-h6twk" (UID: "b07ce16c-1a8d-452d-b97e-8048abd8d86a") : object "kube-system"/"original-pull-secret" not registered
Jul 30 03:34:52.352230 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:52.351459    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6hg\" (UniqueName: \"kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg\") pod \"network-check-target-cd4wm\" (UID: \"52337e3e-c603-4f04-afa7-285827f0bb25\") " pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:52.352230 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:52.351715    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 03:34:52.352230 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:52.351734    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 03:34:52.352230 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:52.351747    2571 projected.go:196] Error preparing data for projected volume kube-api-access-qx6hg for pod openshift-network-diagnostics/network-check-target-cd4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:34:52.352230 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:52.351808    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg podName:52337e3e-c603-4f04-afa7-285827f0bb25 nodeName:}" failed. No retries permitted until 2026-07-30 03:34:56.351789417 +0000 UTC m=+10.190696686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx6hg" (UniqueName: "kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg") pod "network-check-target-cd4wm" (UID: "52337e3e-c603-4f04-afa7-285827f0bb25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:34:52.636691 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:52.636650    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:52.637143 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:52.636780    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:34:52.637143 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:52.637072    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:52.637260 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:52.637194    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:34:53.635509 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:53.635473    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:53.635687 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:53.635632    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:34:54.635099 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:54.635020    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:54.635099 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:54.635073    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:54.635668 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:54.635160    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:34:54.635668 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:54.635254    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:34:55.636257 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:55.635731    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:55.636257 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:55.635885    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:34:56.184604 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:56.184571    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:56.184796 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:56.184743    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:34:56.184796 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:56.184794    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs podName:b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:04.184779362 +0000 UTC m=+18.023686627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs") pod "network-metrics-daemon-9tdmg" (UID: "b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:34:56.285953 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:56.285912    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:56.286121 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:56.286075    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 03:34:56.286176 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:56.286139    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret podName:b07ce16c-1a8d-452d-b97e-8048abd8d86a nodeName:}" failed. No retries permitted until 2026-07-30 03:35:04.286120434 +0000 UTC m=+18.125027703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret") pod "global-pull-secret-syncer-h6twk" (UID: "b07ce16c-1a8d-452d-b97e-8048abd8d86a") : object "kube-system"/"original-pull-secret" not registered
Jul 30 03:34:56.387460 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:56.387249    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6hg\" (UniqueName: \"kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg\") pod \"network-check-target-cd4wm\" (UID: \"52337e3e-c603-4f04-afa7-285827f0bb25\") " pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:56.387460 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:56.387409    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 03:34:56.387460 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:56.387434    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 03:34:56.387460 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:56.387446    2571 projected.go:196] Error preparing data for projected volume kube-api-access-qx6hg for pod openshift-network-diagnostics/network-check-target-cd4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:34:56.387804 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:56.387509    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg podName:52337e3e-c603-4f04-afa7-285827f0bb25 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:04.38749059 +0000 UTC m=+18.226397860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx6hg" (UniqueName: "kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg") pod "network-check-target-cd4wm" (UID: "52337e3e-c603-4f04-afa7-285827f0bb25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:34:56.636425 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:56.636385    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:56.637880 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:56.637524    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:34:56.637880 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:56.637592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:56.637880 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:56.637702    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:34:57.635257 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:57.635220    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:57.635442 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:57.635374    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:34:58.635926 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:58.635888    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:34:58.636348 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:58.635888    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:34:58.636348 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:58.636022    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:34:58.636348 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:58.636107    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:34:59.635835 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:34:59.635799    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:34:59.636031 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:34:59.635942    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:35:00.635390 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:00.635350    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:00.635587 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:00.635354    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:00.635587 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:00.635483    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:35:00.635694 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:00.635669    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:35:01.635386 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:01.635344    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:01.635889 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:01.635497    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:35:02.636000 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:02.635963    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:02.636495 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:02.636162    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:35:02.636495 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:02.636184    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:02.636495 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:02.636299    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:35:03.635065 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:03.635027    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:03.635327 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:03.635167    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:35:04.248500 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:04.248466    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:04.248919 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:04.248666    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:35:04.248919 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:04.248732    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs podName:b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:20.248717693 +0000 UTC m=+34.087624958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs") pod "network-metrics-daemon-9tdmg" (UID: "b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:35:04.349756 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:04.349717    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:04.349923 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:04.349867    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 03:35:04.349985 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:04.349929    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret podName:b07ce16c-1a8d-452d-b97e-8048abd8d86a nodeName:}" failed. No retries permitted until 2026-07-30 03:35:20.34991281 +0000 UTC m=+34.188820095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret") pod "global-pull-secret-syncer-h6twk" (UID: "b07ce16c-1a8d-452d-b97e-8048abd8d86a") : object "kube-system"/"original-pull-secret" not registered
Jul 30 03:35:04.450503 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:04.450460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6hg\" (UniqueName: \"kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg\") pod \"network-check-target-cd4wm\" (UID: \"52337e3e-c603-4f04-afa7-285827f0bb25\") " pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:04.450683 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:04.450654    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 03:35:04.450683 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:04.450679    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 03:35:04.450802 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:04.450693    2571 projected.go:196] Error preparing data for projected volume kube-api-access-qx6hg for pod openshift-network-diagnostics/network-check-target-cd4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:35:04.450802 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:04.450758    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg podName:52337e3e-c603-4f04-afa7-285827f0bb25 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:20.450740514 +0000 UTC m=+34.289647792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx6hg" (UniqueName: "kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg") pod "network-check-target-cd4wm" (UID: "52337e3e-c603-4f04-afa7-285827f0bb25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:35:04.635646 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:04.635612    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:04.635816 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:04.635617    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:04.635816 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:04.635749    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:35:04.635816 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:04.635793    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:35:05.636049 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:05.636012    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:05.636488 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:05.636143    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:35:06.636157 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:06.636116    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:06.636628 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:06.636259    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:35:06.636628 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:06.636303    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:06.636628 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:06.636391    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:35:07.635132 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:07.635094    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:07.635305 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:07.635206    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:35:08.635352 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.635192    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:08.635937 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.635200    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:08.635937 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:08.635452    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:35:08.635937 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:08.635510    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:35:08.729283 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.729068    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-twskj" event={"ID":"79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab","Type":"ContainerStarted","Data":"666f4bd93e342ca189b402b3bea03704557396d6e2f388efd882fe4d39d3fa89"}
Jul 30 03:35:08.730454 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.730425    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ggf25" event={"ID":"e35b41a4-9137-4299-941d-ad6515eb5f89","Type":"ContainerStarted","Data":"878e67b85f838c96e47b1af6752936bd8e89fae1a8c7f607f1792e0e54d8ab7c"}
Jul 30 03:35:08.732177 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.732156    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:35:08.732482 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.732463    2571 generic.go:356] "Generic (PLEG): container finished" podID="2e9e7985-57b1-4487-9907-6c9d98c2ed29" containerID="5d76792b3074d3263fe8213a91972c3bbd4ef31f116d365643e9b4562215b5a4" exitCode=1
Jul 30 03:35:08.732657 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.732522    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9" event={"ID":"2e9e7985-57b1-4487-9907-6c9d98c2ed29","Type":"ContainerStarted","Data":"c3f9a073bea37d93b830a9b7bdba2ff28a5644cba9a02066d4d029980c95cc7f"}
Jul 30 03:35:08.732657 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.732599    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9" event={"ID":"2e9e7985-57b1-4487-9907-6c9d98c2ed29","Type":"ContainerDied","Data":"5d76792b3074d3263fe8213a91972c3bbd4ef31f116d365643e9b4562215b5a4"}
Jul 30 03:35:08.732657 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.732637    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9" event={"ID":"2e9e7985-57b1-4487-9907-6c9d98c2ed29","Type":"ContainerStarted","Data":"21bcd679f6a4902429c58d42613d1a0bff9d1ad2789aa1e4c07f88b8bdc1a6c0"}
Jul 30 03:35:08.734059 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.734015    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w22qn" event={"ID":"551297f1-e510-43c5-a973-a242b44b4576","Type":"ContainerStarted","Data":"dde443e0f3b1729ec6a35bb3e954dfa673179b06c9ada092fb5ec80dfdab160e"}
Jul 30 03:35:08.735388 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.735366    2571 generic.go:356] "Generic (PLEG): container finished" podID="b8bd7c8d-4721-4074-8231-5cd9d1f8f254" containerID="ae0fbe03c04416a6bc6f54f6cc6180bbd91122fc6f5d1244d4bb633a40120c39" exitCode=0
Jul 30 03:35:08.735474 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.735401    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tn52" event={"ID":"b8bd7c8d-4721-4074-8231-5cd9d1f8f254","Type":"ContainerDied","Data":"ae0fbe03c04416a6bc6f54f6cc6180bbd91122fc6f5d1244d4bb633a40120c39"}
Jul 30 03:35:08.737185 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.736972    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-82j8x" event={"ID":"06734eec-1df6-46d2-806d-9c83d5ee5f6b","Type":"ContainerStarted","Data":"8b028500dc41ca307b5f474ebcba878a0cec7e0809fed5cf05c65bd9e9d79678"}
Jul 30 03:35:08.738709 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.738684    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5" event={"ID":"9e1db8ad-0566-40c8-bde9-587fd6fd9e90","Type":"ContainerStarted","Data":"36b18f5c1b98f52fd328cf7e450ae783f483b8a2eccdd18a9a75855176da268d"}
Jul 30 03:35:08.740110 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.740090    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zzb4g" event={"ID":"fa3af588-c3d4-4a7e-a59e-6a17b155dcfe","Type":"ContainerStarted","Data":"ab808300572dcd77336abb9d911eed82a9e6f6fc5e6708c6a6bf8b8bc95a692b"}
Jul 30 03:35:08.746038 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.746000    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-twskj" podStartSLOduration=4.06992078 podStartE2EDuration="22.745986781s" totalImagesPullingTime="18.676066001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:08.745307719 +0000 UTC m=+22.584214984" watchObservedRunningTime="2026-07-30 03:35:08.745986781 +0000 UTC m=+22.584894067"
Jul 30 03:35:08.746138 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.746069    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-241.ec2.internal" podStartSLOduration=20.746065277 podStartE2EDuration="20.746065277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:34:51.712069193 +0000 UTC m=+5.550976482" watchObservedRunningTime="2026-07-30 03:35:08.746065277 +0000 UTC m=+22.584972578"
Jul 30 03:35:08.762210 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.762161    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w22qn" podStartSLOduration=8.430577601 podStartE2EDuration="22.762149065s" totalImagesPullingTime="14.331571464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:08.761646016 +0000 UTC m=+22.600553294" watchObservedRunningTime="2026-07-30 03:35:08.762149065 +0000 UTC m=+22.601056351"
Jul 30 03:35:08.775296 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.775253    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-82j8x" podStartSLOduration=4.124297796 podStartE2EDuration="22.775238891s" totalImagesPullingTime="18.650941095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:08.775212232 +0000 UTC m=+22.614119518" watchObservedRunningTime="2026-07-30 03:35:08.775238891 +0000 UTC m=+22.614146178"
Jul 30 03:35:08.791241 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.791191    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zzb4g" podStartSLOduration=4.070338422 podStartE2EDuration="22.791170647s" totalImagesPullingTime="18.720832225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:08.790493602 +0000 UTC m=+22.629400888" watchObservedRunningTime="2026-07-30 03:35:08.791170647 +0000 UTC m=+22.630077935"
Jul 30 03:35:08.834010 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:08.833968    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ggf25" podStartSLOduration=4.146835943 podStartE2EDuration="22.833954457s" totalImagesPullingTime="18.687118514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:08.833479232 +0000 UTC m=+22.672386519" watchObservedRunningTime="2026-07-30 03:35:08.833954457 +0000 UTC m=+22.672861740"
Jul 30 03:35:09.635706 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:09.635670    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:09.636244 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:09.635826    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:35:09.698915 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:09.698881    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:35:09.699713 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:09.699689    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:35:09.744026 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:09.743936    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ptgkx" event={"ID":"04984729-931b-4439-a61d-690b9d4ef7d5","Type":"ContainerStarted","Data":"0a2ddb8cca961637496c00ce6a32aa0d5fc984acddfd43bd7d0f1deae2bb00bb"}
Jul 30 03:35:09.747052 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:09.747028    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:35:09.747548 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:09.747481    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9" event={"ID":"2e9e7985-57b1-4487-9907-6c9d98c2ed29","Type":"ContainerStarted","Data":"e9b0fb343ea6c6cb549b3e98a7c0eb0afbb8d36f5f27a7381fa5d35a741dd39b"}
Jul 30 03:35:09.747655 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:09.747596    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9" event={"ID":"2e9e7985-57b1-4487-9907-6c9d98c2ed29","Type":"ContainerStarted","Data":"1ce60643ff155a715c4fff22d7b25cc680e07573892300c0cc299e4b7b095d20"}
Jul 30 03:35:09.747655 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:09.747650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9" event={"ID":"2e9e7985-57b1-4487-9907-6c9d98c2ed29","Type":"ContainerStarted","Data":"88385fbc55dc1a0674dc2864ac70889a77b65864b55e9c46fd416d1468d80f7a"}
Jul 30 03:35:09.760182 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:09.760139    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ptgkx" podStartSLOduration=4.114390233 podStartE2EDuration="22.760121576s" totalImagesPullingTime="18.645731343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:09.759957363 +0000 UTC m=+23.598864651" watchObservedRunningTime="2026-07-30 03:35:09.760121576 +0000 UTC m=+23.599028864"
Jul 30 03:35:10.083311 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:10.083276    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 03:35:10.579121 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:10.578964    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T03:35:10.083298603Z","UUID":"247f882a-d9c6-4f3c-9b1c-79c54eb73f47","Handler":null,"Name":"","Endpoint":""}
Jul 30 03:35:10.580768 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:10.580747    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 03:35:10.580911 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:10.580792    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 03:35:10.635381 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:10.635353    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:10.635576 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:10.635361    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:10.635576 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:10.635478    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:35:10.635576 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:10.635565    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:35:10.752952 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:10.752921    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 30 03:35:10.753444 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:10.753210    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5" event={"ID":"9e1db8ad-0566-40c8-bde9-587fd6fd9e90","Type":"ContainerStarted","Data":"80692d7007a758e209325b53a9ef305a345b4037711b47090d96265ebc2a1195"}
Jul 30 03:35:11.636023 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:11.635803    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:11.636164 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:11.636063    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:35:11.757844 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:11.757808    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5" event={"ID":"9e1db8ad-0566-40c8-bde9-587fd6fd9e90","Type":"ContainerStarted","Data":"343885366b655fb6a533900804694e62a7041cc1ab29652191f4b43b36785c2d"}
Jul 30 03:35:11.761613 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:11.761584    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:35:11.761977 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:11.761954    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9" event={"ID":"2e9e7985-57b1-4487-9907-6c9d98c2ed29","Type":"ContainerStarted","Data":"5bbd57af2221873783e7fadea3e4d4a47d4d1c417a5cf0e4d96015fadc7d7e5d"}
Jul 30 03:35:11.779188 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:11.777704    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pm7p5" podStartSLOduration=4.243929141 podStartE2EDuration="25.777686172s" totalImagesPullingTime="21.533757031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:34:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:11.776836213 +0000 UTC m=+25.615743500" watchObservedRunningTime="2026-07-30 03:35:11.777686172 +0000 UTC m=+25.616593461"
Jul 30 03:35:12.635352 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:12.635319    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:12.635591 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:12.635319    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:12.635591 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:12.635447    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:35:12.635591 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:12.635558    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:35:13.635672 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:13.635634    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:13.636274 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:13.635747    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:35:13.772151 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:13.772079    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:35:13.772477 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:13.772450    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9" event={"ID":"2e9e7985-57b1-4487-9907-6c9d98c2ed29","Type":"ContainerStarted","Data":"0b73b682be0b5286076a31479b77398bc8d74e176e18ef41d7460ae9698c285d"}
Jul 30 03:35:13.772763 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:13.772749    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:35:13.772905 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:13.772890    2571 scope.go:117] "RemoveContainer" containerID="5d76792b3074d3263fe8213a91972c3bbd4ef31f116d365643e9b4562215b5a4"
Jul 30 03:35:13.774506 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:13.774482    2571 generic.go:356] "Generic (PLEG): container finished" podID="b8bd7c8d-4721-4074-8231-5cd9d1f8f254" containerID="d109e9894dc171bb271eb645ae6d5a89590d1208b521c441ba047baba368a4ae" exitCode=0
Jul 30 03:35:13.774637 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:13.774522    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tn52" event={"ID":"b8bd7c8d-4721-4074-8231-5cd9d1f8f254","Type":"ContainerDied","Data":"d109e9894dc171bb271eb645ae6d5a89590d1208b521c441ba047baba368a4ae"}
Jul 30 03:35:13.789059 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:13.788968    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:35:14.635853 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:14.635817    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:14.636260 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:14.635932    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:35:14.636260 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:14.635989    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:14.636260 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:14.636098    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:35:14.780466 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:14.780399    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:35:14.780736 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:14.780711    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9" event={"ID":"2e9e7985-57b1-4487-9907-6c9d98c2ed29","Type":"ContainerStarted","Data":"c84dfcd25c5c2eec8cda59a073fbb5c51de367beb593d5dd155bed5dbb3850f0"}
Jul 30 03:35:14.780993 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:14.780973    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:35:14.781046 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:14.781040    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:35:14.796416 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:14.796390    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:35:14.807717 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:14.807672    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9" podStartSLOduration=9.97658344 podStartE2EDuration="28.807656844s" totalImagesPullingTime="18.831073404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:14.806357476 +0000 UTC m=+28.645264763" watchObservedRunningTime="2026-07-30 03:35:14.807656844 +0000 UTC m=+28.646564162"
Jul 30 03:35:15.624772 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:15.624734    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h6twk"]
Jul 30 03:35:15.624942 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:15.624851    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:15.625001 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:15.624976    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:35:15.628372 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:15.628346    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cd4wm"]
Jul 30 03:35:15.628520 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:15.628438    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:15.628604 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:15.628543    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:35:15.629206 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:15.629182    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9tdmg"]
Jul 30 03:35:15.629307 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:15.629299    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:15.629422 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:15.629402    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:35:15.784504 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:15.784469    2571 generic.go:356] "Generic (PLEG): container finished" podID="b8bd7c8d-4721-4074-8231-5cd9d1f8f254" containerID="0c919aadb62f78c87cf9e1aa52dcb106b4f2e885b00f0b0cf96b5407d49bfccb" exitCode=0
Jul 30 03:35:15.784913 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:15.784508    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tn52" event={"ID":"b8bd7c8d-4721-4074-8231-5cd9d1f8f254","Type":"ContainerDied","Data":"0c919aadb62f78c87cf9e1aa52dcb106b4f2e885b00f0b0cf96b5407d49bfccb"}
Jul 30 03:35:16.823856 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:16.823831    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:35:16.824364 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:16.824347    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w22qn"
Jul 30 03:35:17.635919 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:17.635717    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:17.636068 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:17.635719    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:17.636068 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:17.636014    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:35:17.636155 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:17.636065    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:35:17.636155 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:17.635778    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:17.636230 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:17.636158    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:35:17.791514 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:17.791479    2571 generic.go:356] "Generic (PLEG): container finished" podID="b8bd7c8d-4721-4074-8231-5cd9d1f8f254" containerID="246153f1b078796df7a8e45c6155266d3efb1a54d5c8f1c2d28e952e20553e0a" exitCode=0
Jul 30 03:35:17.791725 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:17.791559    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tn52" event={"ID":"b8bd7c8d-4721-4074-8231-5cd9d1f8f254","Type":"ContainerDied","Data":"246153f1b078796df7a8e45c6155266d3efb1a54d5c8f1c2d28e952e20553e0a"}
Jul 30 03:35:19.635909 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:19.635868    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:19.636564 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:19.635916    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:19.636564 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:19.635916    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:19.636564 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:19.635987    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cd4wm" podUID="52337e3e-c603-4f04-afa7-285827f0bb25"
Jul 30 03:35:19.636564 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:19.636090    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:35:19.636564 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:19.636170    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h6twk" podUID="b07ce16c-1a8d-452d-b97e-8048abd8d86a"
Jul 30 03:35:20.269172 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:20.269139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:20.269371 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:20.269301    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:35:20.269441 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:20.269374    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs podName:b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:52.269353279 +0000 UTC m=+66.108260544 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs") pod "network-metrics-daemon-9tdmg" (UID: "b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 03:35:20.370345 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:20.370307    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:20.370561 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:20.370461    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 03:35:20.370561 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:20.370548    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret podName:b07ce16c-1a8d-452d-b97e-8048abd8d86a nodeName:}" failed. No retries permitted until 2026-07-30 03:35:52.3705122 +0000 UTC m=+66.209419479 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret") pod "global-pull-secret-syncer-h6twk" (UID: "b07ce16c-1a8d-452d-b97e-8048abd8d86a") : object "kube-system"/"original-pull-secret" not registered
Jul 30 03:35:20.470983 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:20.470947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6hg\" (UniqueName: \"kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg\") pod \"network-check-target-cd4wm\" (UID: \"52337e3e-c603-4f04-afa7-285827f0bb25\") " pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:20.471174 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:20.471154    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 03:35:20.471252 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:20.471181    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 03:35:20.471252 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:20.471196    2571 projected.go:196] Error preparing data for projected volume kube-api-access-qx6hg for pod openshift-network-diagnostics/network-check-target-cd4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:35:20.471345 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:20.471262    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg podName:52337e3e-c603-4f04-afa7-285827f0bb25 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:52.471240307 +0000 UTC m=+66.310147574 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qx6hg" (UniqueName: "kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg") pod "network-check-target-cd4wm" (UID: "52337e3e-c603-4f04-afa7-285827f0bb25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 03:35:20.980280 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:20.980202    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-241.ec2.internal" event="NodeReady"
Jul 30 03:35:20.980865 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:20.980342    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 03:35:21.024013 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.023919    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f4f97b8d7-567vv"]
Jul 30 03:35:21.054445 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.054412    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"]
Jul 30 03:35:21.054642 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.054570    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.057479 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.057455    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vqpns\""
Jul 30 03:35:21.057647 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.057485    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 03:35:21.057647 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.057602    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 03:35:21.057754 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.057665    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 03:35:21.068401 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.068376    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"]
Jul 30 03:35:21.068555 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.068414    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lrf96"]
Jul 30 03:35:21.068555 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.068517    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:21.071430 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.071404    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8hrdh\""
Jul 30 03:35:21.071600 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.071578    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 30 03:35:21.071784 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.071649    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 30 03:35:21.076990 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.076965    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 03:35:21.084685 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.084663    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f4f97b8d7-567vv"]
Jul 30 03:35:21.084794 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.084701    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.084794 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.084768    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l9dpx"]
Jul 30 03:35:21.087369 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.087351    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 03:35:21.087623 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.087606    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 03:35:21.087623 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.087616    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nmkwv\""
Jul 30 03:35:21.101088 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.101060    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lrf96"]
Jul 30 03:35:21.101190 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.101104    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l9dpx"]
Jul 30 03:35:21.101190 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.101151    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l9dpx"
Jul 30 03:35:21.104853 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.104832    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 03:35:21.104946 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.104869    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 03:35:21.104946 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.104875    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pbdqz\""
Jul 30 03:35:21.105242 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.105227    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 03:35:21.176939 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.176906    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz2bq\" (UniqueName: \"kubernetes.io/projected/27d269fe-b373-4cac-baa6-4d494c197cbb-kube-api-access-lz2bq\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.177139 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.176953    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v2zs\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-kube-api-access-7v2zs\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.177139 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.176982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:21.177139 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177006    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:21.177139 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177032    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mccm\" (UniqueName: \"kubernetes.io/projected/2d51a280-0b63-42bc-9cf0-c5cb62ec8789-kube-api-access-9mccm\") pod \"ingress-canary-l9dpx\" (UID: \"2d51a280-0b63-42bc-9cf0-c5cb62ec8789\") " pod="openshift-ingress-canary/ingress-canary-l9dpx"
Jul 30 03:35:21.177139 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177058    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-trusted-ca\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.177139 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177087    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27d269fe-b373-4cac-baa6-4d494c197cbb-tmp-dir\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.177139 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177131    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.177417 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177202    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-image-registry-private-configuration\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.177417 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177232    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-installation-pull-secrets\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.177417 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177251    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27d269fe-b373-4cac-baa6-4d494c197cbb-config-volume\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.177417 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177297    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49890e4c-9bb3-4d2d-bc62-b68917281161-ca-trust-extracted\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.177417 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177334    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-certificates\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.177417 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177363    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d51a280-0b63-42bc-9cf0-c5cb62ec8789-cert\") pod \"ingress-canary-l9dpx\" (UID: \"2d51a280-0b63-42bc-9cf0-c5cb62ec8789\") " pod="openshift-ingress-canary/ingress-canary-l9dpx"
Jul 30 03:35:21.177417 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.177677 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.177452    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-bound-sa-token\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.278291 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-trusted-ca\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.278291 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278253    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27d269fe-b373-4cac-baa6-4d494c197cbb-tmp-dir\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.278291 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278290    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.278589 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278318    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-image-registry-private-configuration\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.278589 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-installation-pull-secrets\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.278589 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278365    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27d269fe-b373-4cac-baa6-4d494c197cbb-config-volume\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.278589 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278519    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49890e4c-9bb3-4d2d-bc62-b68917281161-ca-trust-extracted\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.278721 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-certificates\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.278721 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278640    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d51a280-0b63-42bc-9cf0-c5cb62ec8789-cert\") pod \"ingress-canary-l9dpx\" (UID: \"2d51a280-0b63-42bc-9cf0-c5cb62ec8789\") " pod="openshift-ingress-canary/ingress-canary-l9dpx"
Jul 30 03:35:21.278721 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.278833 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278713    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27d269fe-b373-4cac-baa6-4d494c197cbb-tmp-dir\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.278833 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278737    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-bound-sa-token\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.278833 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278788    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2bq\" (UniqueName: \"kubernetes.io/projected/27d269fe-b373-4cac-baa6-4d494c197cbb-kube-api-access-lz2bq\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.278922 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278837    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v2zs\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-kube-api-access-7v2zs\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.278922 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:21.278922 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278891    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:21.279007 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.278933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mccm\" (UniqueName: \"kubernetes.io/projected/2d51a280-0b63-42bc-9cf0-c5cb62ec8789-kube-api-access-9mccm\") pod \"ingress-canary-l9dpx\" (UID: \"2d51a280-0b63-42bc-9cf0-c5cb62ec8789\") " pod="openshift-ingress-canary/ingress-canary-l9dpx"
Jul 30 03:35:21.279916 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.279387    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49890e4c-9bb3-4d2d-bc62-b68917281161-ca-trust-extracted\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.279916 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.279599    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 03:35:21.279916 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.279657    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert podName:d97b0e22-d5ae-4a1c-b08a-97c3878c857e nodeName:}" failed. No retries permitted until 2026-07-30 03:35:21.779640879 +0000 UTC m=+35.618548149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-sj8lz" (UID: "d97b0e22-d5ae-4a1c-b08a-97c3878c857e") : secret "networking-console-plugin-cert" not found
Jul 30 03:35:21.279916 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.279669    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27d269fe-b373-4cac-baa6-4d494c197cbb-config-volume\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.279916 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.279813    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:21.279916 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.279839    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 03:35:21.279916 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.279852    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4f97b8d7-567vv: secret "image-registry-tls" not found
Jul 30 03:35:21.279916 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.279851    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-certificates\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.279916 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.279864    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-trusted-ca\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.279916 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.279892    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls podName:49890e4c-9bb3-4d2d-bc62-b68917281161 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:21.779878961 +0000 UTC m=+35.618786250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls") pod "image-registry-5f4f97b8d7-567vv" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161") : secret "image-registry-tls" not found
Jul 30 03:35:21.279916 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.279896    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 03:35:21.280440 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.279957    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls podName:27d269fe-b373-4cac-baa6-4d494c197cbb nodeName:}" failed. No retries permitted until 2026-07-30 03:35:21.77993936 +0000 UTC m=+35.618846660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls") pod "dns-default-lrf96" (UID: "27d269fe-b373-4cac-baa6-4d494c197cbb") : secret "dns-default-metrics-tls" not found
Jul 30 03:35:21.283584 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.283560    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-installation-pull-secrets\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.283683 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.283560    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-image-registry-private-configuration\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.283683 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.283627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d51a280-0b63-42bc-9cf0-c5cb62ec8789-cert\") pod \"ingress-canary-l9dpx\" (UID: \"2d51a280-0b63-42bc-9cf0-c5cb62ec8789\") " pod="openshift-ingress-canary/ingress-canary-l9dpx"
Jul 30 03:35:21.291952 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.291915    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz2bq\" (UniqueName: \"kubernetes.io/projected/27d269fe-b373-4cac-baa6-4d494c197cbb-kube-api-access-lz2bq\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.292082 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.291907    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v2zs\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-kube-api-access-7v2zs\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.292153 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.292132    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-bound-sa-token\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.292617 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.292597    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mccm\" (UniqueName: \"kubernetes.io/projected/2d51a280-0b63-42bc-9cf0-c5cb62ec8789-kube-api-access-9mccm\") pod \"ingress-canary-l9dpx\" (UID: \"2d51a280-0b63-42bc-9cf0-c5cb62ec8789\") " pod="openshift-ingress-canary/ingress-canary-l9dpx"
Jul 30 03:35:21.411749 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.411704    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l9dpx"
Jul 30 03:35:21.635879 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.635848    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:21.635879 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.635868    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:21.636099 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.635860    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:21.643617 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.643588    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvtgp\""
Jul 30 03:35:21.643769 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.643639    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 03:35:21.643865 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.643852    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 03:35:21.643979 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.643961    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 03:35:21.644112 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.644003    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkrkk\""
Jul 30 03:35:21.644432 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.644410    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 03:35:21.783621 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.783592    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:21.783787 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.783657    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:21.783787 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.783769    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 03:35:21.783891 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:21.783777    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:21.783891 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.783822    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls podName:27d269fe-b373-4cac-baa6-4d494c197cbb nodeName:}" failed. No retries permitted until 2026-07-30 03:35:22.783803127 +0000 UTC m=+36.622710393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls") pod "dns-default-lrf96" (UID: "27d269fe-b373-4cac-baa6-4d494c197cbb") : secret "dns-default-metrics-tls" not found
Jul 30 03:35:21.783891 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.783852    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 03:35:21.784056 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.783915    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 03:35:21.784056 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.783930    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4f97b8d7-567vv: secret "image-registry-tls" not found
Jul 30 03:35:21.784056 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.783943    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert podName:d97b0e22-d5ae-4a1c-b08a-97c3878c857e nodeName:}" failed. No retries permitted until 2026-07-30 03:35:22.783928341 +0000 UTC m=+36.622835607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-sj8lz" (UID: "d97b0e22-d5ae-4a1c-b08a-97c3878c857e") : secret "networking-console-plugin-cert" not found
Jul 30 03:35:21.784056 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:21.783974    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls podName:49890e4c-9bb3-4d2d-bc62-b68917281161 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:22.783958838 +0000 UTC m=+36.622866105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls") pod "image-registry-5f4f97b8d7-567vv" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161") : secret "image-registry-tls" not found
Jul 30 03:35:22.085555 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:22.085354    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l9dpx"]
Jul 30 03:35:22.104353 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:35:22.104320    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d51a280_0b63_42bc_9cf0_c5cb62ec8789.slice/crio-b4c744ab1b2a33d7f9c1c1959b2dc7634a2ddc4518cc6cd4ea7a19420a871aea WatchSource:0}: Error finding container b4c744ab1b2a33d7f9c1c1959b2dc7634a2ddc4518cc6cd4ea7a19420a871aea: Status 404 returned error can't find the container with id b4c744ab1b2a33d7f9c1c1959b2dc7634a2ddc4518cc6cd4ea7a19420a871aea
Jul 30 03:35:22.792238 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:22.792196    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:22.792404 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:22.792258    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:22.792404 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:22.792305    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:22.792404 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:22.792366    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 03:35:22.792564 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:22.792418    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 03:35:22.792564 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:22.792423    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 03:35:22.792564 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:22.792432    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls podName:27d269fe-b373-4cac-baa6-4d494c197cbb nodeName:}" failed. No retries permitted until 2026-07-30 03:35:24.792416085 +0000 UTC m=+38.631323351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls") pod "dns-default-lrf96" (UID: "27d269fe-b373-4cac-baa6-4d494c197cbb") : secret "dns-default-metrics-tls" not found
Jul 30 03:35:22.792564 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:22.792439    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4f97b8d7-567vv: secret "image-registry-tls" not found
Jul 30 03:35:22.792564 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:22.792497    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls podName:49890e4c-9bb3-4d2d-bc62-b68917281161 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:24.792479986 +0000 UTC m=+38.631387273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls") pod "image-registry-5f4f97b8d7-567vv" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161") : secret "image-registry-tls" not found
Jul 30 03:35:22.792564 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:22.792510    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert podName:d97b0e22-d5ae-4a1c-b08a-97c3878c857e nodeName:}" failed. No retries permitted until 2026-07-30 03:35:24.792504386 +0000 UTC m=+38.631411651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-sj8lz" (UID: "d97b0e22-d5ae-4a1c-b08a-97c3878c857e") : secret "networking-console-plugin-cert" not found
Jul 30 03:35:22.806025 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:22.805996    2571 generic.go:356] "Generic (PLEG): container finished" podID="b8bd7c8d-4721-4074-8231-5cd9d1f8f254" containerID="ff718810393b212da31bf3e11fc6a44526b484596162693545e0995205403f30" exitCode=0
Jul 30 03:35:22.806171 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:22.806077    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tn52" event={"ID":"b8bd7c8d-4721-4074-8231-5cd9d1f8f254","Type":"ContainerDied","Data":"ff718810393b212da31bf3e11fc6a44526b484596162693545e0995205403f30"}
Jul 30 03:35:22.807149 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:22.807128    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l9dpx" event={"ID":"2d51a280-0b63-42bc-9cf0-c5cb62ec8789","Type":"ContainerStarted","Data":"b4c744ab1b2a33d7f9c1c1959b2dc7634a2ddc4518cc6cd4ea7a19420a871aea"}
Jul 30 03:35:23.814440 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:23.814399    2571 generic.go:356] "Generic (PLEG): container finished" podID="b8bd7c8d-4721-4074-8231-5cd9d1f8f254" containerID="eaa116a1acf08775ff147e7751a21f44cafa3ea98d745f7bc9b1bf386c8b11a8" exitCode=0
Jul 30 03:35:23.814914 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:23.814441    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tn52" event={"ID":"b8bd7c8d-4721-4074-8231-5cd9d1f8f254","Type":"ContainerDied","Data":"eaa116a1acf08775ff147e7751a21f44cafa3ea98d745f7bc9b1bf386c8b11a8"}
Jul 30 03:35:24.809647 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:24.809455    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:24.809810 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:24.809679    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:24.809810 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:24.809619    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 03:35:24.809810 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:24.809717    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:24.809810 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:24.809721    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4f97b8d7-567vv: secret "image-registry-tls" not found
Jul 30 03:35:24.809810 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:24.809780    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 03:35:24.809810 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:24.809793    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls podName:49890e4c-9bb3-4d2d-bc62-b68917281161 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:28.809778779 +0000 UTC m=+42.648686043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls") pod "image-registry-5f4f97b8d7-567vv" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161") : secret "image-registry-tls" not found
Jul 30 03:35:24.810114 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:24.809846    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert podName:d97b0e22-d5ae-4a1c-b08a-97c3878c857e nodeName:}" failed. No retries permitted until 2026-07-30 03:35:28.809821417 +0000 UTC m=+42.648728724 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-sj8lz" (UID: "d97b0e22-d5ae-4a1c-b08a-97c3878c857e") : secret "networking-console-plugin-cert" not found
Jul 30 03:35:24.810114 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:24.809868    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 03:35:24.810114 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:24.809899    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls podName:27d269fe-b373-4cac-baa6-4d494c197cbb nodeName:}" failed. No retries permitted until 2026-07-30 03:35:28.809890236 +0000 UTC m=+42.648797503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls") pod "dns-default-lrf96" (UID: "27d269fe-b373-4cac-baa6-4d494c197cbb") : secret "dns-default-metrics-tls" not found
Jul 30 03:35:24.818716 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:24.818688    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l9dpx" event={"ID":"2d51a280-0b63-42bc-9cf0-c5cb62ec8789","Type":"ContainerStarted","Data":"4c9beb15d12a1c7af6cff457e4381648747a9f013ffc1a26af76e0aeb3ffc4e2"}
Jul 30 03:35:24.821795 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:24.821768    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2tn52" event={"ID":"b8bd7c8d-4721-4074-8231-5cd9d1f8f254","Type":"ContainerStarted","Data":"473936e196918988931e19d0bfce3a0457ee4d79c520dc8293dd3bb6f8bdc246"}
Jul 30 03:35:24.834880 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:24.834833    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l9dpx" podStartSLOduration=1.360131331 podStartE2EDuration="3.834817967s" totalImagesPullingTime="2.474686636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:24.834367331 +0000 UTC m=+38.673274618" watchObservedRunningTime="2026-07-30 03:35:24.834817967 +0000 UTC m=+38.673725280"
Jul 30 03:35:24.858567 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:24.857780    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2tn52" podStartSLOduration=8.05300667 podStartE2EDuration="37.857759693s" totalImagesPullingTime="29.804753023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:34:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:24.855845482 +0000 UTC m=+38.694752769" watchObservedRunningTime="2026-07-30 03:35:24.857759693 +0000 UTC m=+38.696666983"
Jul 30 03:35:28.841964 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:28.841929    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:28.842363 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:28.841991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:28.842363 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:28.842045    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:28.842363 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:28.842080    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 03:35:28.842363 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:28.842135    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 03:35:28.842363 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:28.842143    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert podName:d97b0e22-d5ae-4a1c-b08a-97c3878c857e nodeName:}" failed. No retries permitted until 2026-07-30 03:35:36.842124464 +0000 UTC m=+50.681031743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-sj8lz" (UID: "d97b0e22-d5ae-4a1c-b08a-97c3878c857e") : secret "networking-console-plugin-cert" not found
Jul 30 03:35:28.842363 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:28.842191    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls podName:27d269fe-b373-4cac-baa6-4d494c197cbb nodeName:}" failed. No retries permitted until 2026-07-30 03:35:36.842178184 +0000 UTC m=+50.681085449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls") pod "dns-default-lrf96" (UID: "27d269fe-b373-4cac-baa6-4d494c197cbb") : secret "dns-default-metrics-tls" not found
Jul 30 03:35:28.842363 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:28.842141    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 03:35:28.842363 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:28.842203    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4f97b8d7-567vv: secret "image-registry-tls" not found
Jul 30 03:35:28.842363 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:28.842224    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls podName:49890e4c-9bb3-4d2d-bc62-b68917281161 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:36.842217684 +0000 UTC m=+50.681124949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls") pod "image-registry-5f4f97b8d7-567vv" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161") : secret "image-registry-tls" not found
Jul 30 03:35:36.909431 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:36.909386    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:36.909926 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:36.909444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:36.909926 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:36.909547    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 03:35:36.909926 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:36.909551    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 03:35:36.909926 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:36.909613    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls podName:27d269fe-b373-4cac-baa6-4d494c197cbb nodeName:}" failed. No retries permitted until 2026-07-30 03:35:52.909597358 +0000 UTC m=+66.748504623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls") pod "dns-default-lrf96" (UID: "27d269fe-b373-4cac-baa6-4d494c197cbb") : secret "dns-default-metrics-tls" not found
Jul 30 03:35:36.909926 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:36.909607    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:36.909926 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:36.909558    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4f97b8d7-567vv: secret "image-registry-tls" not found
Jul 30 03:35:36.909926 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:36.909664    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 03:35:36.909926 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:36.909689    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls podName:49890e4c-9bb3-4d2d-bc62-b68917281161 nodeName:}" failed. No retries permitted until 2026-07-30 03:35:52.909677499 +0000 UTC m=+66.748584764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls") pod "image-registry-5f4f97b8d7-567vv" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161") : secret "image-registry-tls" not found
Jul 30 03:35:36.909926 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:36.909715    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert podName:d97b0e22-d5ae-4a1c-b08a-97c3878c857e nodeName:}" failed. No retries permitted until 2026-07-30 03:35:52.909702828 +0000 UTC m=+66.748610093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-sj8lz" (UID: "d97b0e22-d5ae-4a1c-b08a-97c3878c857e") : secret "networking-console-plugin-cert" not found
Jul 30 03:35:46.804080 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:46.804053    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6tl9"
Jul 30 03:35:52.320727 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.320679    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:35:52.323887 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.323865    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 03:35:52.331487 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:52.331462    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 03:35:52.331598 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:52.331564    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs podName:b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359 nodeName:}" failed. No retries permitted until 2026-07-30 03:36:56.331545445 +0000 UTC m=+130.170452726 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs") pod "network-metrics-daemon-9tdmg" (UID: "b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359") : secret "metrics-daemon-secret" not found
Jul 30 03:35:52.421376 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.421327    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:52.424626 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.424607    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 03:35:52.436321 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.436298    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b07ce16c-1a8d-452d-b97e-8048abd8d86a-original-pull-secret\") pod \"global-pull-secret-syncer-h6twk\" (UID: \"b07ce16c-1a8d-452d-b97e-8048abd8d86a\") " pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:52.521990 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.521956    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6hg\" (UniqueName: \"kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg\") pod \"network-check-target-cd4wm\" (UID: \"52337e3e-c603-4f04-afa7-285827f0bb25\") " pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:52.525127 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.525107    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 03:35:52.535191 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.535172    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 03:35:52.546396 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.546375    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx6hg\" (UniqueName: \"kubernetes.io/projected/52337e3e-c603-4f04-afa7-285827f0bb25-kube-api-access-qx6hg\") pod \"network-check-target-cd4wm\" (UID: \"52337e3e-c603-4f04-afa7-285827f0bb25\") " pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:52.556246 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.556227    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h6twk"
Jul 30 03:35:52.564470 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.564442    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkrkk\""
Jul 30 03:35:52.578073 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.577773    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:52.697927 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:35:52.697890    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb07ce16c_1a8d_452d_b97e_8048abd8d86a.slice/crio-ef0feae6c629f4b589927a79dfe1aa9c0356500bb57a2a809277a10803246032 WatchSource:0}: Error finding container ef0feae6c629f4b589927a79dfe1aa9c0356500bb57a2a809277a10803246032: Status 404 returned error can't find the container with id ef0feae6c629f4b589927a79dfe1aa9c0356500bb57a2a809277a10803246032
Jul 30 03:35:52.698864 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.698842    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h6twk"]
Jul 30 03:35:52.720208 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.720187    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cd4wm"]
Jul 30 03:35:52.722353 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:35:52.722329    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52337e3e_c603_4f04_afa7_285827f0bb25.slice/crio-ca058fffa14e1509c11ed34cda43109d1a569065f772cf458a01a19814877ed4 WatchSource:0}: Error finding container ca058fffa14e1509c11ed34cda43109d1a569065f772cf458a01a19814877ed4: Status 404 returned error can't find the container with id ca058fffa14e1509c11ed34cda43109d1a569065f772cf458a01a19814877ed4
Jul 30 03:35:52.887782 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.887749    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cd4wm" event={"ID":"52337e3e-c603-4f04-afa7-285827f0bb25","Type":"ContainerStarted","Data":"ca058fffa14e1509c11ed34cda43109d1a569065f772cf458a01a19814877ed4"}
Jul 30 03:35:52.888818 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.888790    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h6twk" event={"ID":"b07ce16c-1a8d-452d-b97e-8048abd8d86a","Type":"ContainerStarted","Data":"ef0feae6c629f4b589927a79dfe1aa9c0356500bb57a2a809277a10803246032"}
Jul 30 03:35:52.924454 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.924424    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:35:52.924623 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.924469    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:35:52.924623 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:52.924497    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:35:52.924623 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:52.924587    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 03:35:52.924623 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:52.924610    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 03:35:52.924623 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:52.924622    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4f97b8d7-567vv: secret "image-registry-tls" not found
Jul 30 03:35:52.924806 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:52.924609    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 03:35:52.924806 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:52.924648    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert podName:d97b0e22-d5ae-4a1c-b08a-97c3878c857e nodeName:}" failed. No retries permitted until 2026-07-30 03:36:24.924631392 +0000 UTC m=+98.763538656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-sj8lz" (UID: "d97b0e22-d5ae-4a1c-b08a-97c3878c857e") : secret "networking-console-plugin-cert" not found
Jul 30 03:35:52.924806 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:52.924678    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls podName:49890e4c-9bb3-4d2d-bc62-b68917281161 nodeName:}" failed. No retries permitted until 2026-07-30 03:36:24.924666221 +0000 UTC m=+98.763573486 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls") pod "image-registry-5f4f97b8d7-567vv" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161") : secret "image-registry-tls" not found
Jul 30 03:35:52.924806 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:35:52.924688    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls podName:27d269fe-b373-4cac-baa6-4d494c197cbb nodeName:}" failed. No retries permitted until 2026-07-30 03:36:24.924682381 +0000 UTC m=+98.763589646 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls") pod "dns-default-lrf96" (UID: "27d269fe-b373-4cac-baa6-4d494c197cbb") : secret "dns-default-metrics-tls" not found
Jul 30 03:35:57.903933 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:57.903893    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cd4wm" event={"ID":"52337e3e-c603-4f04-afa7-285827f0bb25","Type":"ContainerStarted","Data":"9c93a2c1e0306f113156f44402a5e329f57ecf810d7148d69f6faf82986717dd"}
Jul 30 03:35:57.904439 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:57.903982    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:35:57.905364 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:57.905339    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h6twk" event={"ID":"b07ce16c-1a8d-452d-b97e-8048abd8d86a","Type":"ContainerStarted","Data":"aedb5fdd3d53b05e38842b14348e140760948cae3d40794e65396f51eb048626"}
Jul 30 03:35:57.918404 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:57.918361    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cd4wm" podStartSLOduration=66.297846284 podStartE2EDuration="1m10.918347883s" totalImagesPullingTime="4.620501599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:57.91812458 +0000 UTC m=+71.757031868" watchObservedRunningTime="2026-07-30 03:35:57.918347883 +0000 UTC m=+71.757255183"
Jul 30 03:35:57.935048 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:35:57.935006    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h6twk" podStartSLOduration=66.287572 podStartE2EDuration="1m10.934995901s" totalImagesPullingTime="4.647423901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:35:57.934803547 +0000 UTC m=+71.773710836" watchObservedRunningTime="2026-07-30 03:35:57.934995901 +0000 UTC m=+71.773903188"
Jul 30 03:36:24.962236 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:36:24.962102    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:36:24.962236 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:36:24.962153    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:36:24.962236 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:36:24.962192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:36:24.962854 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:36:24.962273    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 03:36:24.962854 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:36:24.962287    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 03:36:24.962854 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:36:24.962299    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4f97b8d7-567vv: secret "image-registry-tls" not found
Jul 30 03:36:24.962854 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:36:24.962329    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 03:36:24.962854 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:36:24.962358    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert podName:d97b0e22-d5ae-4a1c-b08a-97c3878c857e nodeName:}" failed. No retries permitted until 2026-07-30 03:37:28.962341658 +0000 UTC m=+162.801248941 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-sj8lz" (UID: "d97b0e22-d5ae-4a1c-b08a-97c3878c857e") : secret "networking-console-plugin-cert" not found
Jul 30 03:36:24.962854 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:36:24.962373    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls podName:49890e4c-9bb3-4d2d-bc62-b68917281161 nodeName:}" failed. No retries permitted until 2026-07-30 03:37:28.962367625 +0000 UTC m=+162.801274894 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls") pod "image-registry-5f4f97b8d7-567vv" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161") : secret "image-registry-tls" not found
Jul 30 03:36:24.962854 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:36:24.962398    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls podName:27d269fe-b373-4cac-baa6-4d494c197cbb nodeName:}" failed. No retries permitted until 2026-07-30 03:37:28.962384407 +0000 UTC m=+162.801291672 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls") pod "dns-default-lrf96" (UID: "27d269fe-b373-4cac-baa6-4d494c197cbb") : secret "dns-default-metrics-tls" not found
Jul 30 03:36:28.910222 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:36:28.910191    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cd4wm"
Jul 30 03:36:56.393510 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:36:56.393458    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:36:56.394023 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:36:56.393624    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 03:36:56.394023 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:36:56.393703    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs podName:b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:58.393687585 +0000 UTC m=+252.232594854 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs") pod "network-metrics-daemon-9tdmg" (UID: "b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359") : secret "metrics-daemon-secret" not found
Jul 30 03:37:24.068272 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:37:24.068227    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv" podUID="49890e4c-9bb3-4d2d-bc62-b68917281161"
Jul 30 03:37:24.079409 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:37:24.079378    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz" podUID="d97b0e22-d5ae-4a1c-b08a-97c3878c857e"
Jul 30 03:37:24.095680 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:37:24.095650    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lrf96" podUID="27d269fe-b373-4cac-baa6-4d494c197cbb"
Jul 30 03:37:24.108970 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:37:24.108946    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:37:24.109087 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:37:24.108946    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrf96"
Jul 30 03:37:24.649586 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:37:24.649549    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:37:29.023865 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:37:29.023821    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:37:29.024360 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:37:29.023897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:37:29.024360 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:37:29.023953    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:37:29.024360 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:37:29.023996    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 03:37:29.024360 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:37:29.024008    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 03:37:29.024360 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:37:29.024054    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 03:37:29.024360 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:37:29.024081    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert podName:d97b0e22-d5ae-4a1c-b08a-97c3878c857e nodeName:}" failed. No retries permitted until 2026-07-30 03:39:31.024064347 +0000 UTC m=+284.862971616 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-sj8lz" (UID: "d97b0e22-d5ae-4a1c-b08a-97c3878c857e") : secret "networking-console-plugin-cert" not found
Jul 30 03:37:29.024360 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:37:29.024109    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls podName:27d269fe-b373-4cac-baa6-4d494c197cbb nodeName:}" failed. No retries permitted until 2026-07-30 03:39:31.024093334 +0000 UTC m=+284.863000599 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls") pod "dns-default-lrf96" (UID: "27d269fe-b373-4cac-baa6-4d494c197cbb") : secret "dns-default-metrics-tls" not found
Jul 30 03:37:29.024360 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:37:29.024015    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f4f97b8d7-567vv: secret "image-registry-tls" not found
Jul 30 03:37:29.024360 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:37:29.024150    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls podName:49890e4c-9bb3-4d2d-bc62-b68917281161 nodeName:}" failed. No retries permitted until 2026-07-30 03:39:31.024139661 +0000 UTC m=+284.863046948 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls") pod "image-registry-5f4f97b8d7-567vv" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161") : secret "image-registry-tls" not found
Jul 30 03:37:34.635580 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:37:34.635547    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:37:35.636074 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:37:35.636036    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:38:52.060548 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.060497    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"]
Jul 30 03:38:52.062485 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.062462    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-q2h8n"]
Jul 30 03:38:52.062634 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.062607    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:52.064036 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.064015    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nvl2b"]
Jul 30 03:38:52.064137 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.064124    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.064937 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.064915    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 30 03:38:52.065103 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.065082    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 03:38:52.065196 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.065165    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rwgxz\""
Jul 30 03:38:52.065196 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.065165    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 03:38:52.065579 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.065555    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"]
Jul 30 03:38:52.065713 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.065670    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nvl2b"
Jul 30 03:38:52.066791 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.066768    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 30 03:38:52.066876 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.066769    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 30 03:38:52.066932 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.066915    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"
Jul 30 03:38:52.067749 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.067731    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-k8xl4\""
Jul 30 03:38:52.067837 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.067780    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 30 03:38:52.067837 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.067732    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 30 03:38:52.067837 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.067731    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 30 03:38:52.067953 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.067927    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-926nr\""
Jul 30 03:38:52.069159 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.069130    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 30 03:38:52.069251 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.069168    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 30 03:38:52.071185 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.070687    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 30 03:38:52.071482 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.071461    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 30 03:38:52.072625 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.072606    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wkfmz\""
Jul 30 03:38:52.077217 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.077197    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nvl2b"]
Jul 30 03:38:52.079128 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.079108    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 30 03:38:52.080105 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.080082    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-q2h8n"]
Jul 30 03:38:52.080950 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.080926    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"]
Jul 30 03:38:52.081798 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.081778    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"]
Jul 30 03:38:52.119881 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.119850    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs87f\" (UniqueName: \"kubernetes.io/projected/962291de-6f8e-48e1-88f0-eaaca9a30f9d-kube-api-access-qs87f\") pod \"network-check-source-7d88cb55d8-nvl2b\" (UID: \"962291de-6f8e-48e1-88f0-eaaca9a30f9d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nvl2b"
Jul 30 03:38:52.119881 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.119881    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77ba57ce-96dd-4028-b187-411bd28f7dc0-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv\" (UID: \"77ba57ce-96dd-4028-b187-411bd28f7dc0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"
Jul 30 03:38:52.120063 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.119901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fe25127-ce0b-448a-965d-28b276bea49f-trusted-ca\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.120063 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.119919    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3fe25127-ce0b-448a-965d-28b276bea49f-serving-cert\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.120063 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.119982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:52.120063 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.120034    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77ba57ce-96dd-4028-b187-411bd28f7dc0-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv\" (UID: \"77ba57ce-96dd-4028-b187-411bd28f7dc0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"
Jul 30 03:38:52.120063 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.120059    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rzl6\" (UniqueName: \"kubernetes.io/projected/3fe25127-ce0b-448a-965d-28b276bea49f-kube-api-access-2rzl6\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.120235 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.120090    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:52.120235 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.120117    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fe25127-ce0b-448a-965d-28b276bea49f-config\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.120235 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.120133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzfcl\" (UniqueName: \"kubernetes.io/projected/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-kube-api-access-xzfcl\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:52.120235 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.120200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnffs\" (UniqueName: \"kubernetes.io/projected/77ba57ce-96dd-4028-b187-411bd28f7dc0-kube-api-access-qnffs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv\" (UID: \"77ba57ce-96dd-4028-b187-411bd28f7dc0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"
Jul 30 03:38:52.152704 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.152674    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jkcpc"]
Jul 30 03:38:52.154588 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.154571    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.157777 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.157756    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 03:38:52.157998 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.157982    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 30 03:38:52.158077 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.157992    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hnvh2\""
Jul 30 03:38:52.158077 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.158067    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 30 03:38:52.158695 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.158679    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 03:38:52.162689 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.162666    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8558776bb7-zts8f"]
Jul 30 03:38:52.164508 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.164489    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.166061 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.166039    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jkcpc"]
Jul 30 03:38:52.166666 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.166647    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 30 03:38:52.167110 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.167094    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 30 03:38:52.167181 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.167171    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 30 03:38:52.167554 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.167518    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 30 03:38:52.168202 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.168188    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 30 03:38:52.168202 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.168195    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 03:38:52.168319 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.168272    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 03:38:52.169140 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.169123    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lgkwp\""
Jul 30 03:38:52.188497 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.188472    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8558776bb7-zts8f"]
Jul 30 03:38:52.220739 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.220709    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fe25127-ce0b-448a-965d-28b276bea49f-trusted-ca\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.220865 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.220750    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4htvv\" (UniqueName: \"kubernetes.io/projected/6b42a150-6153-4428-9e0b-e13307f18e96-kube-api-access-4htvv\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.220865 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.220775    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b42a150-6153-4428-9e0b-e13307f18e96-serving-cert\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.220865 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.220804    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3fe25127-ce0b-448a-965d-28b276bea49f-serving-cert\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.220865 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.220832    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-stats-auth\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.220865 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.220852    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pjrc\" (UniqueName: \"kubernetes.io/projected/90ba3f14-0f5d-4fb7-a723-774259f302e7-kube-api-access-5pjrc\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.221018 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.220878    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b42a150-6153-4428-9e0b-e13307f18e96-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.221018 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.220934    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:52.221082 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221014    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.221082 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:52.221025    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 03:38:52.221082 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221072    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77ba57ce-96dd-4028-b187-411bd28f7dc0-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv\" (UID: \"77ba57ce-96dd-4028-b187-411bd28f7dc0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"
Jul 30 03:38:52.221265 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:52.221112    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls podName:6ec6d01b-1aa1-4fa5-a91b-730b736604fe nodeName:}" failed. No retries permitted until 2026-07-30 03:38:52.721091874 +0000 UTC m=+246.559999144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-87r8g" (UID: "6ec6d01b-1aa1-4fa5-a91b-730b736604fe") : secret "cluster-monitoring-operator-tls" not found
Jul 30 03:38:52.221265 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221144    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rzl6\" (UniqueName: \"kubernetes.io/projected/3fe25127-ce0b-448a-965d-28b276bea49f-kube-api-access-2rzl6\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.221265 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.221265 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221220    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:52.221509 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221264    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fe25127-ce0b-448a-965d-28b276bea49f-config\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.221509 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221290    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfcl\" (UniqueName: \"kubernetes.io/projected/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-kube-api-access-xzfcl\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:52.221509 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221415    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b42a150-6153-4428-9e0b-e13307f18e96-snapshots\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.221509 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221449    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-default-certificate\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.221737 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221565    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnffs\" (UniqueName: \"kubernetes.io/projected/77ba57ce-96dd-4028-b187-411bd28f7dc0-kube-api-access-qnffs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv\" (UID: \"77ba57ce-96dd-4028-b187-411bd28f7dc0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"
Jul 30 03:38:52.221737 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221611    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs87f\" (UniqueName: \"kubernetes.io/projected/962291de-6f8e-48e1-88f0-eaaca9a30f9d-kube-api-access-qs87f\") pod \"network-check-source-7d88cb55d8-nvl2b\" (UID: \"962291de-6f8e-48e1-88f0-eaaca9a30f9d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nvl2b"
Jul 30 03:38:52.221737 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77ba57ce-96dd-4028-b187-411bd28f7dc0-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv\" (UID: \"77ba57ce-96dd-4028-b187-411bd28f7dc0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"
Jul 30 03:38:52.221737 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221667    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b42a150-6153-4428-9e0b-e13307f18e96-tmp\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.221737 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221670    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77ba57ce-96dd-4028-b187-411bd28f7dc0-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv\" (UID: \"77ba57ce-96dd-4028-b187-411bd28f7dc0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"
Jul 30 03:38:52.221737 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b42a150-6153-4428-9e0b-e13307f18e96-service-ca-bundle\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.222104 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221745    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fe25127-ce0b-448a-965d-28b276bea49f-trusted-ca\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.222104 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.221935    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fe25127-ce0b-448a-965d-28b276bea49f-config\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.222258 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.222234    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:52.223446 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.223429    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3fe25127-ce0b-448a-965d-28b276bea49f-serving-cert\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.223668 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.223653    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77ba57ce-96dd-4028-b187-411bd28f7dc0-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv\" (UID: \"77ba57ce-96dd-4028-b187-411bd28f7dc0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"
Jul 30 03:38:52.244113 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.244088    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs87f\" (UniqueName: \"kubernetes.io/projected/962291de-6f8e-48e1-88f0-eaaca9a30f9d-kube-api-access-qs87f\") pod \"network-check-source-7d88cb55d8-nvl2b\" (UID: \"962291de-6f8e-48e1-88f0-eaaca9a30f9d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nvl2b"
Jul 30 03:38:52.244222 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.244139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnffs\" (UniqueName: \"kubernetes.io/projected/77ba57ce-96dd-4028-b187-411bd28f7dc0-kube-api-access-qnffs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv\" (UID: \"77ba57ce-96dd-4028-b187-411bd28f7dc0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"
Jul 30 03:38:52.244381 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.244350    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rzl6\" (UniqueName: \"kubernetes.io/projected/3fe25127-ce0b-448a-965d-28b276bea49f-kube-api-access-2rzl6\") pod \"console-operator-584dcb6b54-q2h8n\" (UID: \"3fe25127-ce0b-448a-965d-28b276bea49f\") " pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.244416 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.244378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzfcl\" (UniqueName: \"kubernetes.io/projected/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-kube-api-access-xzfcl\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:52.322240 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322163    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b42a150-6153-4428-9e0b-e13307f18e96-snapshots\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.322240 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-default-certificate\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.322240 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322220    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b42a150-6153-4428-9e0b-e13307f18e96-tmp\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.322493 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322244    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b42a150-6153-4428-9e0b-e13307f18e96-service-ca-bundle\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.322493 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4htvv\" (UniqueName: \"kubernetes.io/projected/6b42a150-6153-4428-9e0b-e13307f18e96-kube-api-access-4htvv\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.322493 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b42a150-6153-4428-9e0b-e13307f18e96-serving-cert\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.322493 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-stats-auth\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.322493 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322348    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pjrc\" (UniqueName: \"kubernetes.io/projected/90ba3f14-0f5d-4fb7-a723-774259f302e7-kube-api-access-5pjrc\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.322493 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322385    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b42a150-6153-4428-9e0b-e13307f18e96-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.322493 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322421    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.322493 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.322893 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:52.322659    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle podName:90ba3f14-0f5d-4fb7-a723-774259f302e7 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:52.822638862 +0000 UTC m=+246.661546150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle") pod "router-default-8558776bb7-zts8f" (UID: "90ba3f14-0f5d-4fb7-a723-774259f302e7") : configmap references non-existent config key: service-ca.crt
Jul 30 03:38:52.322893 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322812    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b42a150-6153-4428-9e0b-e13307f18e96-tmp\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.322893 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322876    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b42a150-6153-4428-9e0b-e13307f18e96-snapshots\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.323040 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:52.322910    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 03:38:52.323040 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:52.322968    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs podName:90ba3f14-0f5d-4fb7-a723-774259f302e7 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:52.822951405 +0000 UTC m=+246.661858686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs") pod "router-default-8558776bb7-zts8f" (UID: "90ba3f14-0f5d-4fb7-a723-774259f302e7") : secret "router-metrics-certs-default" not found
Jul 30 03:38:52.323040 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.322967    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b42a150-6153-4428-9e0b-e13307f18e96-service-ca-bundle\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.323747 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.323727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b42a150-6153-4428-9e0b-e13307f18e96-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.324840 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.324821    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b42a150-6153-4428-9e0b-e13307f18e96-serving-cert\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.324946 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.324889    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-default-certificate\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.324946 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.324936    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-stats-auth\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.332426 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.332407    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pjrc\" (UniqueName: \"kubernetes.io/projected/90ba3f14-0f5d-4fb7-a723-774259f302e7-kube-api-access-5pjrc\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.332563 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.332546    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4htvv\" (UniqueName: \"kubernetes.io/projected/6b42a150-6153-4428-9e0b-e13307f18e96-kube-api-access-4htvv\") pod \"insights-operator-5885fdb759-jkcpc\" (UID: \"6b42a150-6153-4428-9e0b-e13307f18e96\") " pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.385762 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.385721    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:38:52.391291 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.391267    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nvl2b"
Jul 30 03:38:52.395979 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.395958    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"
Jul 30 03:38:52.464809 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.464106    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-jkcpc"
Jul 30 03:38:52.537836 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.537459    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-q2h8n"]
Jul 30 03:38:52.540158 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:38:52.540133    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe25127_ce0b_448a_965d_28b276bea49f.slice/crio-b13cb392f4f4fb578f33ac5e2d6dc176533096e04405290a138ae1327bbc47d5 WatchSource:0}: Error finding container b13cb392f4f4fb578f33ac5e2d6dc176533096e04405290a138ae1327bbc47d5: Status 404 returned error can't find the container with id b13cb392f4f4fb578f33ac5e2d6dc176533096e04405290a138ae1327bbc47d5
Jul 30 03:38:52.598613 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.598507    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-jkcpc"]
Jul 30 03:38:52.600865 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:38:52.600838    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b42a150_6153_4428_9e0b_e13307f18e96.slice/crio-27e8d20af08a07484c80908676cf48e2c759eacc24a972cb2acc3c75928b9914 WatchSource:0}: Error finding container 27e8d20af08a07484c80908676cf48e2c759eacc24a972cb2acc3c75928b9914: Status 404 returned error can't find the container with id 27e8d20af08a07484c80908676cf48e2c759eacc24a972cb2acc3c75928b9914
Jul 30 03:38:52.728381 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.728340    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:52.728566 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:52.728450    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 03:38:52.728566 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:52.728505    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls podName:6ec6d01b-1aa1-4fa5-a91b-730b736604fe nodeName:}" failed. No retries permitted until 2026-07-30 03:38:53.728492492 +0000 UTC m=+247.567399756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-87r8g" (UID: "6ec6d01b-1aa1-4fa5-a91b-730b736604fe") : secret "cluster-monitoring-operator-tls" not found
Jul 30 03:38:52.755168 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.755129    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv"]
Jul 30 03:38:52.756176 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.756071    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nvl2b"]
Jul 30 03:38:52.758726 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:38:52.758689    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ba57ce_96dd_4028_b187_411bd28f7dc0.slice/crio-3f0caaa17a85f1459d98ce3382db787f8167d68477f3103eba4bab0fe1330705 WatchSource:0}: Error finding container 3f0caaa17a85f1459d98ce3382db787f8167d68477f3103eba4bab0fe1330705: Status 404 returned error can't find the container with id 3f0caaa17a85f1459d98ce3382db787f8167d68477f3103eba4bab0fe1330705
Jul 30 03:38:52.759008 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:38:52.758985    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962291de_6f8e_48e1_88f0_eaaca9a30f9d.slice/crio-52968981f4cfc26845565780f22cb6add041c1bfd206d7e8dae0ef1d7a2a395c WatchSource:0}: Error finding container 52968981f4cfc26845565780f22cb6add041c1bfd206d7e8dae0ef1d7a2a395c: Status 404 returned error can't find the container with id 52968981f4cfc26845565780f22cb6add041c1bfd206d7e8dae0ef1d7a2a395c
Jul 30 03:38:52.828937 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.828897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.829068 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:52.828971    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:52.829068 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:52.829031    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 03:38:52.829146 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:52.829105    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs podName:90ba3f14-0f5d-4fb7-a723-774259f302e7 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:53.829084938 +0000 UTC m=+247.667992204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs") pod "router-default-8558776bb7-zts8f" (UID: "90ba3f14-0f5d-4fb7-a723-774259f302e7") : secret "router-metrics-certs-default" not found
Jul 30 03:38:52.829146 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:52.829119    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle podName:90ba3f14-0f5d-4fb7-a723-774259f302e7 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:53.829112959 +0000 UTC m=+247.668020223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle") pod "router-default-8558776bb7-zts8f" (UID: "90ba3f14-0f5d-4fb7-a723-774259f302e7") : configmap references non-existent config key: service-ca.crt
Jul 30 03:38:53.321287 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:53.320964    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nvl2b" event={"ID":"962291de-6f8e-48e1-88f0-eaaca9a30f9d","Type":"ContainerStarted","Data":"bbeda18def32e0c7d9732ad3a8dbb1f615203cd5bacbdd6a1150bcadad568327"}
Jul 30 03:38:53.321287 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:53.321074    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nvl2b" event={"ID":"962291de-6f8e-48e1-88f0-eaaca9a30f9d","Type":"ContainerStarted","Data":"52968981f4cfc26845565780f22cb6add041c1bfd206d7e8dae0ef1d7a2a395c"}
Jul 30 03:38:53.322682 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:53.322650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jkcpc" event={"ID":"6b42a150-6153-4428-9e0b-e13307f18e96","Type":"ContainerStarted","Data":"27e8d20af08a07484c80908676cf48e2c759eacc24a972cb2acc3c75928b9914"}
Jul 30 03:38:53.323995 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:53.323949    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n" event={"ID":"3fe25127-ce0b-448a-965d-28b276bea49f","Type":"ContainerStarted","Data":"b13cb392f4f4fb578f33ac5e2d6dc176533096e04405290a138ae1327bbc47d5"}
Jul 30 03:38:53.325583 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:53.325555    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv" event={"ID":"77ba57ce-96dd-4028-b187-411bd28f7dc0","Type":"ContainerStarted","Data":"3f0caaa17a85f1459d98ce3382db787f8167d68477f3103eba4bab0fe1330705"}
Jul 30 03:38:53.737155 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:53.737103    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:53.737517 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:53.737496    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 03:38:53.737627 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:53.737595    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls podName:6ec6d01b-1aa1-4fa5-a91b-730b736604fe nodeName:}" failed. No retries permitted until 2026-07-30 03:38:55.737572051 +0000 UTC m=+249.576479330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-87r8g" (UID: "6ec6d01b-1aa1-4fa5-a91b-730b736604fe") : secret "cluster-monitoring-operator-tls" not found
Jul 30 03:38:53.838688 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:53.838641    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:53.838829 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:53.838810    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:53.838962 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:53.838945    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 03:38:53.839023 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:53.839013    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs podName:90ba3f14-0f5d-4fb7-a723-774259f302e7 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:55.838993183 +0000 UTC m=+249.677900449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs") pod "router-default-8558776bb7-zts8f" (UID: "90ba3f14-0f5d-4fb7-a723-774259f302e7") : secret "router-metrics-certs-default" not found
Jul 30 03:38:53.839451 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:53.839405    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle podName:90ba3f14-0f5d-4fb7-a723-774259f302e7 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:55.839386391 +0000 UTC m=+249.678293669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle") pod "router-default-8558776bb7-zts8f" (UID: "90ba3f14-0f5d-4fb7-a723-774259f302e7") : configmap references non-existent config key: service-ca.crt
Jul 30 03:38:55.757411 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:55.757377    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:55.757930 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:55.757509    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 03:38:55.757930 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:55.757578    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls podName:6ec6d01b-1aa1-4fa5-a91b-730b736604fe nodeName:}" failed. No retries permitted until 2026-07-30 03:38:59.757561997 +0000 UTC m=+253.596469273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-87r8g" (UID: "6ec6d01b-1aa1-4fa5-a91b-730b736604fe") : secret "cluster-monitoring-operator-tls" not found
Jul 30 03:38:55.858785 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:55.858748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:55.858944 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:55.858820    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:55.858944 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:55.858896    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 03:38:55.859014 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:55.858968    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs podName:90ba3f14-0f5d-4fb7-a723-774259f302e7 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:59.858946407 +0000 UTC m=+253.697853672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs") pod "router-default-8558776bb7-zts8f" (UID: "90ba3f14-0f5d-4fb7-a723-774259f302e7") : secret "router-metrics-certs-default" not found
Jul 30 03:38:55.859063 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:55.859005    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle podName:90ba3f14-0f5d-4fb7-a723-774259f302e7 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:59.858986928 +0000 UTC m=+253.697894197 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle") pod "router-default-8558776bb7-zts8f" (UID: "90ba3f14-0f5d-4fb7-a723-774259f302e7") : configmap references non-existent config key: service-ca.crt
Jul 30 03:38:56.335566 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:56.335511    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jkcpc" event={"ID":"6b42a150-6153-4428-9e0b-e13307f18e96","Type":"ContainerStarted","Data":"76f24928e0ecf568475f04194c876d6c8626b38416328ec0dfd19e5c9a0a7ffc"}
Jul 30 03:38:56.337129 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:56.337107    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/0.log"
Jul 30 03:38:56.337255 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:56.337142    2571 generic.go:356] "Generic (PLEG): container finished" podID="3fe25127-ce0b-448a-965d-28b276bea49f" containerID="fbfefbf492086af75d2cec5802c1414474be29993f278eff1816fdb0bef62ef4" exitCode=255
Jul 30 03:38:56.337255 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:56.337181    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n" event={"ID":"3fe25127-ce0b-448a-965d-28b276bea49f","Type":"ContainerDied","Data":"fbfefbf492086af75d2cec5802c1414474be29993f278eff1816fdb0bef62ef4"}
Jul 30 03:38:56.337447 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:56.337432    2571 scope.go:117] "RemoveContainer" containerID="fbfefbf492086af75d2cec5802c1414474be29993f278eff1816fdb0bef62ef4"
Jul 30 03:38:56.338720 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:56.338696    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv" event={"ID":"77ba57ce-96dd-4028-b187-411bd28f7dc0","Type":"ContainerStarted","Data":"3759739e8fe35399a7af19111750e31948b1aa7846b80b71417006ffda033e3c"}
Jul 30 03:38:56.353562 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:56.353455    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-jkcpc" podStartSLOduration=1.273204038 podStartE2EDuration="4.353436899s" totalImagesPullingTime="3.080232861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:38:56.352728714 +0000 UTC m=+250.191636000" watchObservedRunningTime="2026-07-30 03:38:56.353436899 +0000 UTC m=+250.192344188"
Jul 30 03:38:56.354362 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:56.354322    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nvl2b" podStartSLOduration=4.354306087 podStartE2EDuration="4.354306087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:38:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:38:53.338060795 +0000 UTC m=+247.176968084" watchObservedRunningTime="2026-07-30 03:38:56.354306087 +0000 UTC m=+250.193213375"
Jul 30 03:38:56.384576 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:56.384507    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv" podStartSLOduration=1.4616216770000001 podStartE2EDuration="4.384491009s" totalImagesPullingTime="2.922869332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:38:56.383288448 +0000 UTC m=+250.222195736" watchObservedRunningTime="2026-07-30 03:38:56.384491009 +0000 UTC m=+250.223398296"
Jul 30 03:38:57.343080 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.343049    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/1.log"
Jul 30 03:38:57.343521 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.343507    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/0.log"
Jul 30 03:38:57.343581 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.343563    2571 generic.go:356] "Generic (PLEG): container finished" podID="3fe25127-ce0b-448a-965d-28b276bea49f" containerID="f8a61f28a6e4d1621d341c7ace1a2e41c7b5a4398fd989e3dc6d1cd6ea2c8808" exitCode=255
Jul 30 03:38:57.343675 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.343650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n" event={"ID":"3fe25127-ce0b-448a-965d-28b276bea49f","Type":"ContainerDied","Data":"f8a61f28a6e4d1621d341c7ace1a2e41c7b5a4398fd989e3dc6d1cd6ea2c8808"}
Jul 30 03:38:57.343724 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.343711    2571 scope.go:117] "RemoveContainer" containerID="fbfefbf492086af75d2cec5802c1414474be29993f278eff1816fdb0bef62ef4"
Jul 30 03:38:57.343964 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.343944    2571 scope.go:117] "RemoveContainer" containerID="f8a61f28a6e4d1621d341c7ace1a2e41c7b5a4398fd989e3dc6d1cd6ea2c8808"
Jul 30 03:38:57.344158 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:57.344137    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-q2h8n_openshift-console-operator(3fe25127-ce0b-448a-965d-28b276bea49f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n" podUID="3fe25127-ce0b-448a-965d-28b276bea49f"
Jul 30 03:38:57.662854 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.662821    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4j7w8"]
Jul 30 03:38:57.666601 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.666578    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.669039 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.669010    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 03:38:57.669039 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.669037    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-97fcc\""
Jul 30 03:38:57.669216 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.669011    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 03:38:57.675726 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.675704    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4j7w8"]
Jul 30 03:38:57.776060 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.776028    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.776213 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.776072    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68372db1-feb8-4217-8af7-f9024c7c7a25-crio-socket\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.776213 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.776100    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68372db1-feb8-4217-8af7-f9024c7c7a25-data-volume\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.776213 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.776144    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.776213 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.776161    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f478\" (UniqueName: \"kubernetes.io/projected/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-api-access-5f478\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.876776 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.876740    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.876776 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.876775    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f478\" (UniqueName: \"kubernetes.io/projected/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-api-access-5f478\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.876981 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.876841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.876981 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:57.876864    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 03:38:57.876981 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:57.876939    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm podName:68372db1-feb8-4217-8af7-f9024c7c7a25 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:58.376923048 +0000 UTC m=+252.215830316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4j7w8" (UID: "68372db1-feb8-4217-8af7-f9024c7c7a25") : configmap "kube-rbac-proxy" not found
Jul 30 03:38:57.876981 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.876938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68372db1-feb8-4217-8af7-f9024c7c7a25-crio-socket\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.876981 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.876871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68372db1-feb8-4217-8af7-f9024c7c7a25-crio-socket\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.876981 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:57.876974    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 03:38:57.877179 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.877001    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68372db1-feb8-4217-8af7-f9024c7c7a25-data-volume\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.877179 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:57.877033    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls podName:68372db1-feb8-4217-8af7-f9024c7c7a25 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:58.377017652 +0000 UTC m=+252.215924925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4j7w8" (UID: "68372db1-feb8-4217-8af7-f9024c7c7a25") : secret "insights-runtime-extractor-tls" not found
Jul 30 03:38:57.877320 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.877305    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68372db1-feb8-4217-8af7-f9024c7c7a25-data-volume\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:57.885031 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:57.885003    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f478\" (UniqueName: \"kubernetes.io/projected/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-api-access-5f478\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:58.347805 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:58.347772    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/1.log"
Jul 30 03:38:58.348182 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:58.348116    2571 scope.go:117] "RemoveContainer" containerID="f8a61f28a6e4d1621d341c7ace1a2e41c7b5a4398fd989e3dc6d1cd6ea2c8808"
Jul 30 03:38:58.348289 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:58.348268    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-q2h8n_openshift-console-operator(3fe25127-ce0b-448a-965d-28b276bea49f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n" podUID="3fe25127-ce0b-448a-965d-28b276bea49f"
Jul 30 03:38:58.380486 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:58.380460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:58.380651 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:58.380552    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:58.380651 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:58.380597    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 03:38:58.380720 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:58.380655    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm podName:68372db1-feb8-4217-8af7-f9024c7c7a25 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:59.380639311 +0000 UTC m=+253.219546576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4j7w8" (UID: "68372db1-feb8-4217-8af7-f9024c7c7a25") : configmap "kube-rbac-proxy" not found
Jul 30 03:38:58.380720 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:58.380660    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 03:38:58.380720 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:58.380702    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls podName:68372db1-feb8-4217-8af7-f9024c7c7a25 nodeName:}" failed. No retries permitted until 2026-07-30 03:38:59.380691092 +0000 UTC m=+253.219598358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4j7w8" (UID: "68372db1-feb8-4217-8af7-f9024c7c7a25") : secret "insights-runtime-extractor-tls" not found
Jul 30 03:38:58.481809 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:58.481757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:38:58.481983 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:58.481917    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 03:38:58.482049 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:58.481996    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs podName:b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359 nodeName:}" failed. No retries permitted until 2026-07-30 03:41:00.481976377 +0000 UTC m=+374.320883641 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs") pod "network-metrics-daemon-9tdmg" (UID: "b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359") : secret "metrics-daemon-secret" not found
Jul 30 03:38:58.964764 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:58.962898    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6"]
Jul 30 03:38:58.967195 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:58.967168    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6"
Jul 30 03:38:58.969683 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:58.969640    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 30 03:38:58.969801 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:58.969765    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-d65nv\""
Jul 30 03:38:58.970667 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:58.970648    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 30 03:38:58.979093 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:58.979067    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6"]
Jul 30 03:38:59.087139 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:59.087102    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m96d4\" (UniqueName: \"kubernetes.io/projected/f32fe676-c050-4287-aac7-119600a358b5-kube-api-access-m96d4\") pod \"migrator-6865c9967-mbkt6\" (UID: \"f32fe676-c050-4287-aac7-119600a358b5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6"
Jul 30 03:38:59.188604 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:59.188561    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m96d4\" (UniqueName: \"kubernetes.io/projected/f32fe676-c050-4287-aac7-119600a358b5-kube-api-access-m96d4\") pod \"migrator-6865c9967-mbkt6\" (UID: \"f32fe676-c050-4287-aac7-119600a358b5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6"
Jul 30 03:38:59.197316 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:59.197288    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m96d4\" (UniqueName: \"kubernetes.io/projected/f32fe676-c050-4287-aac7-119600a358b5-kube-api-access-m96d4\") pod \"migrator-6865c9967-mbkt6\" (UID: \"f32fe676-c050-4287-aac7-119600a358b5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6"
Jul 30 03:38:59.276558 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:59.276453    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6"
Jul 30 03:38:59.390073 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:59.390040    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:59.390482 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:59.390163    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:38:59.390482 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:59.390177    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 03:38:59.390482 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:59.390243    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls podName:68372db1-feb8-4217-8af7-f9024c7c7a25 nodeName:}" failed. No retries permitted until 2026-07-30 03:39:01.390221467 +0000 UTC m=+255.229128749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4j7w8" (UID: "68372db1-feb8-4217-8af7-f9024c7c7a25") : secret "insights-runtime-extractor-tls" not found
Jul 30 03:38:59.390482 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:59.390306    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 03:38:59.390482 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:59.390368    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm podName:68372db1-feb8-4217-8af7-f9024c7c7a25 nodeName:}" failed. No retries permitted until 2026-07-30 03:39:01.390354766 +0000 UTC m=+255.229262048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4j7w8" (UID: "68372db1-feb8-4217-8af7-f9024c7c7a25") : configmap "kube-rbac-proxy" not found
Jul 30 03:38:59.401436 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:59.401411    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6"]
Jul 30 03:38:59.405234 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:38:59.405210    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf32fe676_c050_4287_aac7_119600a358b5.slice/crio-52be5aceacbed44b0de78f946da4bf1a749b3e471c674f6bbd0dc0726c17b4d7 WatchSource:0}: Error finding container 52be5aceacbed44b0de78f946da4bf1a749b3e471c674f6bbd0dc0726c17b4d7: Status 404 returned error can't find the container with id 52be5aceacbed44b0de78f946da4bf1a749b3e471c674f6bbd0dc0726c17b4d7
Jul 30 03:38:59.793710 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:59.793670    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:38:59.793890 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:59.793843    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 03:38:59.793931 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:59.793919    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls podName:6ec6d01b-1aa1-4fa5-a91b-730b736604fe nodeName:}" failed. No retries permitted until 2026-07-30 03:39:07.793902493 +0000 UTC m=+261.632809774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-87r8g" (UID: "6ec6d01b-1aa1-4fa5-a91b-730b736604fe") : secret "cluster-monitoring-operator-tls" not found
Jul 30 03:38:59.858668 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:59.858639    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-twskj_79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab/dns-node-resolver/0.log"
Jul 30 03:38:59.895174 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:59.895137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:59.895338 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:38:59.895197    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:38:59.895338 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:59.895296    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 03:38:59.895421 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:59.895360    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs podName:90ba3f14-0f5d-4fb7-a723-774259f302e7 nodeName:}" failed. No retries permitted until 2026-07-30 03:39:07.895342884 +0000 UTC m=+261.734250170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs") pod "router-default-8558776bb7-zts8f" (UID: "90ba3f14-0f5d-4fb7-a723-774259f302e7") : secret "router-metrics-certs-default" not found
Jul 30 03:38:59.895421 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:38:59.895374    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle podName:90ba3f14-0f5d-4fb7-a723-774259f302e7 nodeName:}" failed. No retries permitted until 2026-07-30 03:39:07.895368467 +0000 UTC m=+261.734275732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle") pod "router-default-8558776bb7-zts8f" (UID: "90ba3f14-0f5d-4fb7-a723-774259f302e7") : configmap references non-existent config key: service-ca.crt
Jul 30 03:39:00.356052 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:00.356014    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6" event={"ID":"f32fe676-c050-4287-aac7-119600a358b5","Type":"ContainerStarted","Data":"52be5aceacbed44b0de78f946da4bf1a749b3e471c674f6bbd0dc0726c17b4d7"}
Jul 30 03:39:00.458520 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:00.458490    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-82j8x_06734eec-1df6-46d2-806d-9c83d5ee5f6b/node-ca/0.log"
Jul 30 03:39:01.360538 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:01.360492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6" event={"ID":"f32fe676-c050-4287-aac7-119600a358b5","Type":"ContainerStarted","Data":"caac3218b5cb9727cd39e0ae96eae31a44dad988c60d45a345f1ac32edb6c98f"}
Jul 30 03:39:01.360716 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:01.360567    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6" event={"ID":"f32fe676-c050-4287-aac7-119600a358b5","Type":"ContainerStarted","Data":"3fa12184a751c72002d0102eeb6035ef0247acb63f91fa6546eee9ae5ee8fd90"}
Jul 30 03:39:01.376819 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:01.376771    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mbkt6" podStartSLOduration=2.225704909 podStartE2EDuration="3.376755605s" totalImagesPullingTime="1.151050696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:01.375607403 +0000 UTC m=+255.214514703" watchObservedRunningTime="2026-07-30 03:39:01.376755605 +0000 UTC m=+255.215662942"
Jul 30 03:39:01.409176 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:01.409149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:39:01.409276 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:01.409227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:39:01.409323 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:01.409291    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 03:39:01.409355 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:01.409350    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls podName:68372db1-feb8-4217-8af7-f9024c7c7a25 nodeName:}" failed. No retries permitted until 2026-07-30 03:39:05.409336886 +0000 UTC m=+259.248244154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4j7w8" (UID: "68372db1-feb8-4217-8af7-f9024c7c7a25") : secret "insights-runtime-extractor-tls" not found
Jul 30 03:39:01.409400 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:01.409301    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 03:39:01.409439 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:01.409421    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm podName:68372db1-feb8-4217-8af7-f9024c7c7a25 nodeName:}" failed. No retries permitted until 2026-07-30 03:39:05.409410733 +0000 UTC m=+259.248317998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4j7w8" (UID: "68372db1-feb8-4217-8af7-f9024c7c7a25") : configmap "kube-rbac-proxy" not found
Jul 30 03:39:01.457723 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:01.457696    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l9dpx_2d51a280-0b63-42bc-9cf0-c5cb62ec8789/serve-healthcheck-canary/0.log"
Jul 30 03:39:02.385825 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:02.385794    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:39:02.386295 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:02.385865    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:39:02.386364 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:02.386302    2571 scope.go:117] "RemoveContainer" containerID="f8a61f28a6e4d1621d341c7ace1a2e41c7b5a4398fd989e3dc6d1cd6ea2c8808"
Jul 30 03:39:02.386515 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:02.386491    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-q2h8n_openshift-console-operator(3fe25127-ce0b-448a-965d-28b276bea49f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n" podUID="3fe25127-ce0b-448a-965d-28b276bea49f"
Jul 30 03:39:05.448356 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:05.448313    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:39:05.448778 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:05.448404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:39:05.448778 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:05.448473    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 03:39:05.448778 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:05.448474    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 03:39:05.448778 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:05.448554    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm podName:68372db1-feb8-4217-8af7-f9024c7c7a25 nodeName:}" failed. No retries permitted until 2026-07-30 03:39:13.448521302 +0000 UTC m=+267.287428567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4j7w8" (UID: "68372db1-feb8-4217-8af7-f9024c7c7a25") : configmap "kube-rbac-proxy" not found
Jul 30 03:39:05.448778 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:05.448570    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls podName:68372db1-feb8-4217-8af7-f9024c7c7a25 nodeName:}" failed. No retries permitted until 2026-07-30 03:39:13.448563466 +0000 UTC m=+267.287470731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4j7w8" (UID: "68372db1-feb8-4217-8af7-f9024c7c7a25") : secret "insights-runtime-extractor-tls" not found
Jul 30 03:39:07.870715 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:07.870625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:39:07.871079 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:07.870773    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 03:39:07.871079 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:07.870837    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls podName:6ec6d01b-1aa1-4fa5-a91b-730b736604fe nodeName:}" failed. No retries permitted until 2026-07-30 03:39:23.870822462 +0000 UTC m=+277.709729728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-87r8g" (UID: "6ec6d01b-1aa1-4fa5-a91b-730b736604fe") : secret "cluster-monitoring-operator-tls" not found
Jul 30 03:39:07.971283 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:07.971247    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:39:07.971482 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:07.971347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:39:07.971947 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:07.971922    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ba3f14-0f5d-4fb7-a723-774259f302e7-service-ca-bundle\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:39:07.973671 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:07.973640    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90ba3f14-0f5d-4fb7-a723-774259f302e7-metrics-certs\") pod \"router-default-8558776bb7-zts8f\" (UID: \"90ba3f14-0f5d-4fb7-a723-774259f302e7\") " pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:39:08.072749 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:08.072708    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:39:08.199508 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:08.199471    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8558776bb7-zts8f"]
Jul 30 03:39:08.204399 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:39:08.204373    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ba3f14_0f5d_4fb7_a723_774259f302e7.slice/crio-31348e2acbb5e762b190020f7ded8bbe2331574dccfdb024d9653116a7991831 WatchSource:0}: Error finding container 31348e2acbb5e762b190020f7ded8bbe2331574dccfdb024d9653116a7991831: Status 404 returned error can't find the container with id 31348e2acbb5e762b190020f7ded8bbe2331574dccfdb024d9653116a7991831
Jul 30 03:39:08.384271 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:08.384232    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8558776bb7-zts8f" event={"ID":"90ba3f14-0f5d-4fb7-a723-774259f302e7","Type":"ContainerStarted","Data":"57be71a664d47bee92825e997755f7a4d37892c2594cd625e15faccb036aea2a"}
Jul 30 03:39:08.384440 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:08.384298    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8558776bb7-zts8f" event={"ID":"90ba3f14-0f5d-4fb7-a723-774259f302e7","Type":"ContainerStarted","Data":"31348e2acbb5e762b190020f7ded8bbe2331574dccfdb024d9653116a7991831"}
Jul 30 03:39:08.407910 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:08.407821    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8558776bb7-zts8f" podStartSLOduration=16.407805872 podStartE2EDuration="16.407805872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:38:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:08.407077317 +0000 UTC m=+262.245984604" watchObservedRunningTime="2026-07-30 03:39:08.407805872 +0000 UTC m=+262.246713166"
Jul 30 03:39:09.073375 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:09.073329    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:39:09.075852 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:09.075829    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:39:09.387186 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:09.387159    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:39:09.388373 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:09.388349    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8558776bb7-zts8f"
Jul 30 03:39:13.520694 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:13.520650    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:39:13.521155 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:13.520738    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:39:13.521216 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:13.521196    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68372db1-feb8-4217-8af7-f9024c7c7a25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:39:13.522940 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:13.522917    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68372db1-feb8-4217-8af7-f9024c7c7a25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4j7w8\" (UID: \"68372db1-feb8-4217-8af7-f9024c7c7a25\") " pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:39:13.576126 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:13.576073    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4j7w8"
Jul 30 03:39:13.636161 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:13.636132    2571 scope.go:117] "RemoveContainer" containerID="f8a61f28a6e4d1621d341c7ace1a2e41c7b5a4398fd989e3dc6d1cd6ea2c8808"
Jul 30 03:39:13.707092 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:13.707066    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4j7w8"]
Jul 30 03:39:13.710607 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:39:13.710573    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68372db1_feb8_4217_8af7_f9024c7c7a25.slice/crio-1f959fa61d536a4e0ae5253812f28eeb977de177f548ff0ec4cd60fe6cb6a3ab WatchSource:0}: Error finding container 1f959fa61d536a4e0ae5253812f28eeb977de177f548ff0ec4cd60fe6cb6a3ab: Status 404 returned error can't find the container with id 1f959fa61d536a4e0ae5253812f28eeb977de177f548ff0ec4cd60fe6cb6a3ab
Jul 30 03:39:14.407730 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:14.407700    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:39:14.408842 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:14.408651    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/1.log"
Jul 30 03:39:14.408842 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:14.408697    2571 generic.go:356] "Generic (PLEG): container finished" podID="3fe25127-ce0b-448a-965d-28b276bea49f" containerID="a7ce0e124ec1b74d958afff5e950a7292602b253b21295659cdf8e5569cefdf9" exitCode=255
Jul 30 03:39:14.408842 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:14.408798    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n" event={"ID":"3fe25127-ce0b-448a-965d-28b276bea49f","Type":"ContainerDied","Data":"a7ce0e124ec1b74d958afff5e950a7292602b253b21295659cdf8e5569cefdf9"}
Jul 30 03:39:14.409103 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:14.408881    2571 scope.go:117] "RemoveContainer" containerID="f8a61f28a6e4d1621d341c7ace1a2e41c7b5a4398fd989e3dc6d1cd6ea2c8808"
Jul 30 03:39:14.409886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:14.409415    2571 scope.go:117] "RemoveContainer" containerID="a7ce0e124ec1b74d958afff5e950a7292602b253b21295659cdf8e5569cefdf9"
Jul 30 03:39:14.409886 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:14.409684    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-q2h8n_openshift-console-operator(3fe25127-ce0b-448a-965d-28b276bea49f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n" podUID="3fe25127-ce0b-448a-965d-28b276bea49f"
Jul 30 03:39:14.411144 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:14.411114    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4j7w8" event={"ID":"68372db1-feb8-4217-8af7-f9024c7c7a25","Type":"ContainerStarted","Data":"1f959fa61d536a4e0ae5253812f28eeb977de177f548ff0ec4cd60fe6cb6a3ab"}
Jul 30 03:39:15.417797 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:15.417760    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:39:19.434632 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:19.434592    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4j7w8" event={"ID":"68372db1-feb8-4217-8af7-f9024c7c7a25","Type":"ContainerStarted","Data":"f5fd657d0b862f37e35e024701ec0c54def140a75f2c484529304520a698a2bb"}
Jul 30 03:39:22.385852 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:22.385823    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:39:22.386277 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:22.385868    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:39:22.386277 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:22.386177    2571 scope.go:117] "RemoveContainer" containerID="a7ce0e124ec1b74d958afff5e950a7292602b253b21295659cdf8e5569cefdf9"
Jul 30 03:39:22.386360 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:22.386323    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-q2h8n_openshift-console-operator(3fe25127-ce0b-448a-965d-28b276bea49f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n" podUID="3fe25127-ce0b-448a-965d-28b276bea49f"
Jul 30 03:39:22.447321 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:22.447280    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4j7w8" event={"ID":"68372db1-feb8-4217-8af7-f9024c7c7a25","Type":"ContainerStarted","Data":"7952dab28713b383bad83edcfc8ea4f5de0d45184bca017f444ff8df6f951eac"}
Jul 30 03:39:23.907170 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:23.907124    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:39:23.909997 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:23.909972    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ec6d01b-1aa1-4fa5-a91b-730b736604fe-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-87r8g\" (UID: \"6ec6d01b-1aa1-4fa5-a91b-730b736604fe\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:39:24.178639 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:24.178543    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"
Jul 30 03:39:25.471071 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:25.471040    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g"]
Jul 30 03:39:25.473689 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:39:25.473665    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec6d01b_1aa1_4fa5_a91b_730b736604fe.slice/crio-8d1168221b4542cfdfcfa9cb1243489a2eb12c090c13719f6f2ed23dc4f3d1c5 WatchSource:0}: Error finding container 8d1168221b4542cfdfcfa9cb1243489a2eb12c090c13719f6f2ed23dc4f3d1c5: Status 404 returned error can't find the container with id 8d1168221b4542cfdfcfa9cb1243489a2eb12c090c13719f6f2ed23dc4f3d1c5
Jul 30 03:39:26.464437 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:26.464404    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4j7w8" event={"ID":"68372db1-feb8-4217-8af7-f9024c7c7a25","Type":"ContainerStarted","Data":"bef3bcf400dc527ed12cd76ef8b4f6e9fcb5c6706e8e10ef21af8b34fe760bd5"}
Jul 30 03:39:26.465468 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:26.465446    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g" event={"ID":"6ec6d01b-1aa1-4fa5-a91b-730b736604fe","Type":"ContainerStarted","Data":"8d1168221b4542cfdfcfa9cb1243489a2eb12c090c13719f6f2ed23dc4f3d1c5"}
Jul 30 03:39:26.482309 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:26.482263    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4j7w8" podStartSLOduration=17.907966621 podStartE2EDuration="29.482248901s" totalImagesPullingTime="11.57428228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 03:38:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:26.481979771 +0000 UTC m=+280.320887060" watchObservedRunningTime="2026-07-30 03:39:26.482248901 +0000 UTC m=+280.321156192"
Jul 30 03:39:27.110037 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:27.109990    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv" podUID="49890e4c-9bb3-4d2d-bc62-b68917281161"
Jul 30 03:39:27.110037 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:27.110002    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lrf96" podUID="27d269fe-b373-4cac-baa6-4d494c197cbb"
Jul 30 03:39:27.468679 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:27.468651    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrf96"
Jul 30 03:39:27.468768 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:27.468651    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:39:28.472987 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:28.472951    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g" event={"ID":"6ec6d01b-1aa1-4fa5-a91b-730b736604fe","Type":"ContainerStarted","Data":"4940febdad405fcc5aa9a92def02ba4eca817608fed51da7229b7ff9fb5160c6"}
Jul 30 03:39:28.488628 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:28.488579    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-87r8g" podStartSLOduration=34.517196996 podStartE2EDuration="36.488562791s" totalImagesPullingTime="1.971365795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:28.487472155 +0000 UTC m=+282.326379442" watchObservedRunningTime="2026-07-30 03:39:28.488562791 +0000 UTC m=+282.327470077"
Jul 30 03:39:31.010447 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.010410    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"]
Jul 30 03:39:31.013163 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.013147    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.015721 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.015697    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 30 03:39:31.016793 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.016775    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 30 03:39:31.016876 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.016779    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 03:39:31.016876 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.016797    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vwtg9\""
Jul 30 03:39:31.024189 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.024160    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"]
Jul 30 03:39:31.063181 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.063139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9594df7-b6a2-4245-a6a5-cca0e387ec17-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.063354 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.063187    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9594df7-b6a2-4245-a6a5-cca0e387ec17-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.063354 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.063273    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp7m9\" (UniqueName: \"kubernetes.io/projected/b9594df7-b6a2-4245-a6a5-cca0e387ec17-kube-api-access-gp7m9\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.063354 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.063328    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:39:31.063497 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.063387    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9594df7-b6a2-4245-a6a5-cca0e387ec17-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.063497 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.063418    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:39:31.063497 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.063440    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:39:31.065688 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.065662    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d269fe-b373-4cac-baa6-4d494c197cbb-metrics-tls\") pod \"dns-default-lrf96\" (UID: \"27d269fe-b373-4cac-baa6-4d494c197cbb\") " pod="openshift-dns/dns-default-lrf96"
Jul 30 03:39:31.065832 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.065703    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"image-registry-5f4f97b8d7-567vv\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") " pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:39:31.065955 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.065936    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d97b0e22-d5ae-4a1c-b08a-97c3878c857e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-sj8lz\" (UID: \"d97b0e22-d5ae-4a1c-b08a-97c3878c857e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:39:31.072714 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.072692    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nmkwv\""
Jul 30 03:39:31.072714 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.072708    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vqpns\""
Jul 30 03:39:31.079920 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.079873    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lrf96"
Jul 30 03:39:31.080001 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.079898    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:39:31.165797 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.164908    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9594df7-b6a2-4245-a6a5-cca0e387ec17-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.165797 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.164977    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9594df7-b6a2-4245-a6a5-cca0e387ec17-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.165797 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.165012    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9594df7-b6a2-4245-a6a5-cca0e387ec17-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.165797 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.165066    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp7m9\" (UniqueName: \"kubernetes.io/projected/b9594df7-b6a2-4245-a6a5-cca0e387ec17-kube-api-access-gp7m9\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.165797 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:31.165541    2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 30 03:39:31.165797 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:31.165606    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9594df7-b6a2-4245-a6a5-cca0e387ec17-prometheus-operator-tls podName:b9594df7-b6a2-4245-a6a5-cca0e387ec17 nodeName:}" failed. No retries permitted until 2026-07-30 03:39:31.665585838 +0000 UTC m=+285.504493103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b9594df7-b6a2-4245-a6a5-cca0e387ec17-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-hz2ps" (UID: "b9594df7-b6a2-4245-a6a5-cca0e387ec17") : secret "prometheus-operator-tls" not found
Jul 30 03:39:31.166490 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.166282    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9594df7-b6a2-4245-a6a5-cca0e387ec17-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.168508 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.168467    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9594df7-b6a2-4245-a6a5-cca0e387ec17-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.173893 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.173841    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp7m9\" (UniqueName: \"kubernetes.io/projected/b9594df7-b6a2-4245-a6a5-cca0e387ec17-kube-api-access-gp7m9\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.233885 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.233828    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f4f97b8d7-567vv"]
Jul 30 03:39:31.236048 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:39:31.236020    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49890e4c_9bb3_4d2d_bc62_b68917281161.slice/crio-11e422b042f9d5f1aca49f2b1dee715a203ea59d7f0c525f8bf11ce2068dee2e WatchSource:0}: Error finding container 11e422b042f9d5f1aca49f2b1dee715a203ea59d7f0c525f8bf11ce2068dee2e: Status 404 returned error can't find the container with id 11e422b042f9d5f1aca49f2b1dee715a203ea59d7f0c525f8bf11ce2068dee2e
Jul 30 03:39:31.248582 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.248561    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lrf96"]
Jul 30 03:39:31.251349 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:39:31.251323    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d269fe_b373_4cac_baa6_4d494c197cbb.slice/crio-409d734897103eb1d3ef4dd78118c7c685d73b0a10d09bcd0b4366e3783e517f WatchSource:0}: Error finding container 409d734897103eb1d3ef4dd78118c7c685d73b0a10d09bcd0b4366e3783e517f: Status 404 returned error can't find the container with id 409d734897103eb1d3ef4dd78118c7c685d73b0a10d09bcd0b4366e3783e517f
Jul 30 03:39:31.339425 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.339393    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8hrdh\""
Jul 30 03:39:31.347598 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.347567    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"
Jul 30 03:39:31.472503 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.472472    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz"]
Jul 30 03:39:31.475724 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:39:31.475699    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97b0e22_d5ae_4a1c_b08a_97c3878c857e.slice/crio-6162e85d8503f4c45105478edbf5b51d8becae01e1323e4b66bb9006c68d8e6e WatchSource:0}: Error finding container 6162e85d8503f4c45105478edbf5b51d8becae01e1323e4b66bb9006c68d8e6e: Status 404 returned error can't find the container with id 6162e85d8503f4c45105478edbf5b51d8becae01e1323e4b66bb9006c68d8e6e
Jul 30 03:39:31.484514 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.484483    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrf96" event={"ID":"27d269fe-b373-4cac-baa6-4d494c197cbb","Type":"ContainerStarted","Data":"409d734897103eb1d3ef4dd78118c7c685d73b0a10d09bcd0b4366e3783e517f"}
Jul 30 03:39:31.485632 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.485607    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz" event={"ID":"d97b0e22-d5ae-4a1c-b08a-97c3878c857e","Type":"ContainerStarted","Data":"6162e85d8503f4c45105478edbf5b51d8becae01e1323e4b66bb9006c68d8e6e"}
Jul 30 03:39:31.486953 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.486932    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv" event={"ID":"49890e4c-9bb3-4d2d-bc62-b68917281161","Type":"ContainerStarted","Data":"2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d"}
Jul 30 03:39:31.487037 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.486968    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv" event={"ID":"49890e4c-9bb3-4d2d-bc62-b68917281161","Type":"ContainerStarted","Data":"11e422b042f9d5f1aca49f2b1dee715a203ea59d7f0c525f8bf11ce2068dee2e"}
Jul 30 03:39:31.487096 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.487058    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:39:31.506052 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.505998    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv" podStartSLOduration=285.505982119 podStartE2EDuration="4m45.505982119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:31.505653595 +0000 UTC m=+285.344560883" watchObservedRunningTime="2026-07-30 03:39:31.505982119 +0000 UTC m=+285.344889384"
Jul 30 03:39:31.668069 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.668023    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9594df7-b6a2-4245-a6a5-cca0e387ec17-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.670229 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.670198    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9594df7-b6a2-4245-a6a5-cca0e387ec17-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hz2ps\" (UID: \"b9594df7-b6a2-4245-a6a5-cca0e387ec17\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:31.922275 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:31.922186    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"
Jul 30 03:39:32.064902 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:32.064871    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hz2ps"]
Jul 30 03:39:32.068220 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:39:32.068192    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9594df7_b6a2_4245_a6a5_cca0e387ec17.slice/crio-ef0eec4ad1f399cf30557c4cfb2ca66f6e394158e53fd661e72e923819444665 WatchSource:0}: Error finding container ef0eec4ad1f399cf30557c4cfb2ca66f6e394158e53fd661e72e923819444665: Status 404 returned error can't find the container with id ef0eec4ad1f399cf30557c4cfb2ca66f6e394158e53fd661e72e923819444665
Jul 30 03:39:32.492375 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:32.492330    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps" event={"ID":"b9594df7-b6a2-4245-a6a5-cca0e387ec17","Type":"ContainerStarted","Data":"ef0eec4ad1f399cf30557c4cfb2ca66f6e394158e53fd661e72e923819444665"}
Jul 30 03:39:33.498474 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:33.498435    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz" event={"ID":"d97b0e22-d5ae-4a1c-b08a-97c3878c857e","Type":"ContainerStarted","Data":"0aa4f317bc744b88a15858a88f5730988dc7d88ae2a589aea25626329dbd69fb"}
Jul 30 03:39:33.514887 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:33.514784    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-sj8lz" podStartSLOduration=282.738706055 podStartE2EDuration="4m44.514764245s" totalImagesPullingTime="1.77605819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:33.513960953 +0000 UTC m=+287.352868241" watchObservedRunningTime="2026-07-30 03:39:33.514764245 +0000 UTC m=+287.353671531"
Jul 30 03:39:34.504104 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:34.504069    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps" event={"ID":"b9594df7-b6a2-4245-a6a5-cca0e387ec17","Type":"ContainerStarted","Data":"dddbdcd6a6d1acd72a950a1da59c8c7a54b3cb72dfa71ad46eac69697d9978de"}
Jul 30 03:39:34.504680 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:34.504124    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps" event={"ID":"b9594df7-b6a2-4245-a6a5-cca0e387ec17","Type":"ContainerStarted","Data":"b8b5e74ed4bc9456036882432dfa90cd77f9be0a431305c44755d5e5f447a28c"}
Jul 30 03:39:34.505865 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:34.505842    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrf96" event={"ID":"27d269fe-b373-4cac-baa6-4d494c197cbb","Type":"ContainerStarted","Data":"6a57f8c4db0f7324cc90a10352d084325bb7428d9b049df0d3ec568ee04653b1"}
Jul 30 03:39:34.505972 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:34.505885    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lrf96" event={"ID":"27d269fe-b373-4cac-baa6-4d494c197cbb","Type":"ContainerStarted","Data":"fb4c3f655aaaaaacfc1b39b6ff38904c9ec439fbfda0af118d49a50f7892e27c"}
Jul 30 03:39:34.506056 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:34.506041    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lrf96"
Jul 30 03:39:34.520226 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:34.520177    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-hz2ps" podStartSLOduration=2.969839904 podStartE2EDuration="4.520162539s" totalImagesPullingTime="1.550322635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:34.519654744 +0000 UTC m=+288.358562032" watchObservedRunningTime="2026-07-30 03:39:34.520162539 +0000 UTC m=+288.359069850"
Jul 30 03:39:34.538610 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:34.538569    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lrf96" podStartSLOduration=251.531435569 podStartE2EDuration="4m13.538555019s" totalImagesPullingTime="2.00711945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:34.537655302 +0000 UTC m=+288.376562588" watchObservedRunningTime="2026-07-30 03:39:34.538555019 +0000 UTC m=+288.377462303"
Jul 30 03:39:34.635933 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:34.635897    2571 scope.go:117] "RemoveContainer" containerID="a7ce0e124ec1b74d958afff5e950a7292602b253b21295659cdf8e5569cefdf9"
Jul 30 03:39:35.511745 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.511719    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:39:35.512178 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.511838    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n" event={"ID":"3fe25127-ce0b-448a-965d-28b276bea49f","Type":"ContainerStarted","Data":"cd9c8682f7bdd114c143bf36f3992c554fdebc4572c22eaa38edb51f6702ca15"}
Jul 30 03:39:35.512431 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.512412    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:39:35.517290 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.517267    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n"
Jul 30 03:39:35.530135 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.530086    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-q2h8n" podStartSLOduration=40.394172052 podStartE2EDuration="43.530071021s" totalImagesPullingTime="3.135898969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:35.529570502 +0000 UTC m=+289.368477781" watchObservedRunningTime="2026-07-30 03:39:35.530071021 +0000 UTC m=+289.368978307"
Jul 30 03:39:35.623044 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.623006    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-kh85j"]
Jul 30 03:39:35.632086 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.632055    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-kh85j"
Jul 30 03:39:35.634763 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.634735    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mdhq7\""
Jul 30 03:39:35.635017 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.634987    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 03:39:35.635133 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.635061    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 03:39:35.635951 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.635922    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-kh85j"]
Jul 30 03:39:35.702370 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.702334    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z62jn\" (UniqueName: \"kubernetes.io/projected/0cdbf51a-6c68-4713-9153-8efba2922d4f-kube-api-access-z62jn\") pod \"downloads-7c97dc4555-kh85j\" (UID: \"0cdbf51a-6c68-4713-9153-8efba2922d4f\") " pod="openshift-console/downloads-7c97dc4555-kh85j"
Jul 30 03:39:35.803028 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.802936    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z62jn\" (UniqueName: \"kubernetes.io/projected/0cdbf51a-6c68-4713-9153-8efba2922d4f-kube-api-access-z62jn\") pod \"downloads-7c97dc4555-kh85j\" (UID: \"0cdbf51a-6c68-4713-9153-8efba2922d4f\") " pod="openshift-console/downloads-7c97dc4555-kh85j"
Jul 30 03:39:35.814866 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.814838    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z62jn\" (UniqueName: \"kubernetes.io/projected/0cdbf51a-6c68-4713-9153-8efba2922d4f-kube-api-access-z62jn\") pod \"downloads-7c97dc4555-kh85j\" (UID: \"0cdbf51a-6c68-4713-9153-8efba2922d4f\") " pod="openshift-console/downloads-7c97dc4555-kh85j"
Jul 30 03:39:35.944443 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:35.944407    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-kh85j"
Jul 30 03:39:36.089455 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.089311    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-kh85j"]
Jul 30 03:39:36.092614 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:39:36.092580    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cdbf51a_6c68_4713_9153_8efba2922d4f.slice/crio-1ffdc5f6972108249db91ecb43bdcee1669e4b1fdc3c6f6c7d4c29ceaa78c472 WatchSource:0}: Error finding container 1ffdc5f6972108249db91ecb43bdcee1669e4b1fdc3c6f6c7d4c29ceaa78c472: Status 404 returned error can't find the container with id 1ffdc5f6972108249db91ecb43bdcee1669e4b1fdc3c6f6c7d4c29ceaa78c472
Jul 30 03:39:36.402513 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.402475    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qm5zx"]
Jul 30 03:39:36.407877 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.407852    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.411411 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.411388    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 03:39:36.411655 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.411638    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 03:39:36.412574 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.412557    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6j2hf\""
Jul 30 03:39:36.412669 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.412602    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 03:39:36.512842 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.512807    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8650a70-864f-4ca6-b6ab-79f605105612-sys\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.512842 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.512849    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-textfile\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.513349 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.512874    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.513349 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.512926    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8650a70-864f-4ca6-b6ab-79f605105612-metrics-client-ca\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.513349 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.512960    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-accelerators-collector-config\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.513349 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.512988    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-wtmp\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.513349 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.513081    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8650a70-864f-4ca6-b6ab-79f605105612-root\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.513349 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.513166    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t22pn\" (UniqueName: \"kubernetes.io/projected/e8650a70-864f-4ca6-b6ab-79f605105612-kube-api-access-t22pn\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.513349 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.513199    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-tls\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.517289 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.517257    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-kh85j" event={"ID":"0cdbf51a-6c68-4713-9153-8efba2922d4f","Type":"ContainerStarted","Data":"1ffdc5f6972108249db91ecb43bdcee1669e4b1fdc3c6f6c7d4c29ceaa78c472"}
Jul 30 03:39:36.613937 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.613889    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8650a70-864f-4ca6-b6ab-79f605105612-sys\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.614121 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.613944    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-textfile\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.614121 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.613979    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.614121 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.614018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8650a70-864f-4ca6-b6ab-79f605105612-metrics-client-ca\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.614121 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.614050    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-accelerators-collector-config\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.614121 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.614086    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-wtmp\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.614362 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.614133    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8650a70-864f-4ca6-b6ab-79f605105612-root\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.614362 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.614160    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t22pn\" (UniqueName: \"kubernetes.io/projected/e8650a70-864f-4ca6-b6ab-79f605105612-kube-api-access-t22pn\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.614362 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.614216    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-tls\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.614570 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.614508    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8650a70-864f-4ca6-b6ab-79f605105612-sys\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.614926 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.614878    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-textfile\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.615035 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.614972    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8650a70-864f-4ca6-b6ab-79f605105612-root\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.615100 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.615068    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-accelerators-collector-config\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.615157 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.615073    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-wtmp\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.615157 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.615120    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8650a70-864f-4ca6-b6ab-79f605105612-metrics-client-ca\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.617451 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.617429    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-tls\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.617589 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.617568    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8650a70-864f-4ca6-b6ab-79f605105612-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.624438 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.624345    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t22pn\" (UniqueName: \"kubernetes.io/projected/e8650a70-864f-4ca6-b6ab-79f605105612-kube-api-access-t22pn\") pod \"node-exporter-qm5zx\" (UID: \"e8650a70-864f-4ca6-b6ab-79f605105612\") " pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.717751 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:36.717663    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qm5zx"
Jul 30 03:39:36.729726 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:39:36.729701    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8650a70_864f_4ca6_b6ab_79f605105612.slice/crio-34063f2f081e0d21d06d9c8b1f1d1ecd20e7b7b307df447685e360b5d6f57bb1 WatchSource:0}: Error finding container 34063f2f081e0d21d06d9c8b1f1d1ecd20e7b7b307df447685e360b5d6f57bb1: Status 404 returned error can't find the container with id 34063f2f081e0d21d06d9c8b1f1d1ecd20e7b7b307df447685e360b5d6f57bb1
Jul 30 03:39:37.525539 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:37.525148    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qm5zx" event={"ID":"e8650a70-864f-4ca6-b6ab-79f605105612","Type":"ContainerStarted","Data":"34063f2f081e0d21d06d9c8b1f1d1ecd20e7b7b307df447685e360b5d6f57bb1"}
Jul 30 03:39:38.532070 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.532035    2571 generic.go:356] "Generic (PLEG): container finished" podID="e8650a70-864f-4ca6-b6ab-79f605105612" containerID="fd66a7bd414da11e9378da38a781e66bdfa8552740db4a308b73dbc2fa32b003" exitCode=0
Jul 30 03:39:38.532591 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.532123    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qm5zx" event={"ID":"e8650a70-864f-4ca6-b6ab-79f605105612","Type":"ContainerDied","Data":"fd66a7bd414da11e9378da38a781e66bdfa8552740db4a308b73dbc2fa32b003"}
Jul 30 03:39:38.590170 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.590134    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"]
Jul 30 03:39:38.593110 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.593088    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.597139 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.597111    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 30 03:39:38.597434 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.597142    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5px2f\""
Jul 30 03:39:38.597434 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.597178    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 30 03:39:38.597434 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.597262    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-37ghvvs9jodi1\""
Jul 30 03:39:38.597643 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.597592    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 30 03:39:38.597832 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.597812    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 30 03:39:38.597943 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.597879    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 30 03:39:38.625730 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.625701    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"]
Jul 30 03:39:38.630610 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.630583    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.630730 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.630650    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.630912 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.630807    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.630912 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.630868    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-grpc-tls\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.631053 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.630935    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-metrics-client-ca\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.631053 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.630996    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-tls\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.631053 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.631042    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.631458 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.631391    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfv49\" (UniqueName: \"kubernetes.io/projected/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-kube-api-access-hfv49\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.637318 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:39:38.637278    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9tdmg" podUID="b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359"
Jul 30 03:39:38.732756 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.732705    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.732953 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.732775    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.732953 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.732812    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-grpc-tls\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.732953 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.732865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-metrics-client-ca\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.732953 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.732909    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-tls\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.732953 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.732939    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.733221 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.732972    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfv49\" (UniqueName: \"kubernetes.io/projected/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-kube-api-access-hfv49\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.733221 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.733011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.734106 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.734076    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-metrics-client-ca\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.736092 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.736061    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.736092 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.736082    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-tls\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.736272 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.736235    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-grpc-tls\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.736344 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.736320    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.737647 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.737616    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.737789 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.737767    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.742967 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.742945    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfv49\" (UniqueName: \"kubernetes.io/projected/5d33ec94-b056-42fc-957f-ac6c6bf4b7fa-kube-api-access-hfv49\") pod \"thanos-querier-579ddf4cf5-6jqxk\" (UID: \"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa\") " pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:38.906100 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:38.906064    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:39.055329 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:39.055295    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"]
Jul 30 03:39:39.058107 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:39:39.058078    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d33ec94_b056_42fc_957f_ac6c6bf4b7fa.slice/crio-d5a13d2017c04a44c93adbb39e09eb8bb5ec827a4f21c10e52e69a1b3d729137 WatchSource:0}: Error finding container d5a13d2017c04a44c93adbb39e09eb8bb5ec827a4f21c10e52e69a1b3d729137: Status 404 returned error can't find the container with id d5a13d2017c04a44c93adbb39e09eb8bb5ec827a4f21c10e52e69a1b3d729137
Jul 30 03:39:39.537909 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:39.537868    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk" event={"ID":"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa","Type":"ContainerStarted","Data":"d5a13d2017c04a44c93adbb39e09eb8bb5ec827a4f21c10e52e69a1b3d729137"}
Jul 30 03:39:39.540575 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:39.540540    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qm5zx" event={"ID":"e8650a70-864f-4ca6-b6ab-79f605105612","Type":"ContainerStarted","Data":"f1ffeba9e27623de97f5b0e58fb14be513493754bc868eacb4081a2c45ced068"}
Jul 30 03:39:39.540714 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:39.540635    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qm5zx" event={"ID":"e8650a70-864f-4ca6-b6ab-79f605105612","Type":"ContainerStarted","Data":"bb5356d49e93d0f5c221005a082400d3b462229542b0a9a5e31a66edb08feb6a"}
Jul 30 03:39:39.559940 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:39.559883    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qm5zx" podStartSLOduration=2.32042767 podStartE2EDuration="3.559862734s" totalImagesPullingTime="1.169337177s" totalInitContainerRuntime="70.097887ms" isStatefulPod=true podCreationTimestamp="2026-07-30 03:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:39.558890368 +0000 UTC m=+293.397797681" watchObservedRunningTime="2026-07-30 03:39:39.559862734 +0000 UTC m=+293.398770024"
Jul 30 03:39:41.550446 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:41.550368    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk" event={"ID":"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa","Type":"ContainerStarted","Data":"7582becf782487411fc88010475b4b911aedd527041f5354094250635021d2ac"}
Jul 30 03:39:41.550446 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:41.550435    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk" event={"ID":"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa","Type":"ContainerStarted","Data":"c628b53bdc01331fd6d7feb0fd881fbbe36023b6cbbfe232b0bf666a8003c088"}
Jul 30 03:39:41.550943 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:41.550466    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk" event={"ID":"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa","Type":"ContainerStarted","Data":"e28bd7dce1401009f12859db975114cb4da287928cab227adaaf92310073dc75"}
Jul 30 03:39:43.563114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:43.563074    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk" event={"ID":"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa","Type":"ContainerStarted","Data":"50a8d217f95038231c3e53ed82e0d18dc8c696f5be01a77f405d32653d9f880c"}
Jul 30 03:39:43.563576 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:43.563161    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk" event={"ID":"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa","Type":"ContainerStarted","Data":"7087db733a62f5265652bbb8d835002843918aa2d97df96ea6438cdb32df803b"}
Jul 30 03:39:43.563576 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:43.563202    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk" event={"ID":"5d33ec94-b056-42fc-957f-ac6c6bf4b7fa","Type":"ContainerStarted","Data":"ee4654101452cca3977627491e28b5bc3d04493e0200fe8ae3abf86de70d0de3"}
Jul 30 03:39:43.563576 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:43.563248    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:43.586104 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:43.586028    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk" podStartSLOduration=2.350543466 podStartE2EDuration="5.586008981s" totalImagesPullingTime="3.235465515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:39:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:43.584537612 +0000 UTC m=+297.423444896" watchObservedRunningTime="2026-07-30 03:39:43.586008981 +0000 UTC m=+297.424916268"
Jul 30 03:39:44.514437 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:44.514399    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lrf96"
Jul 30 03:39:46.515050 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:46.515023    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:39:46.515480 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:46.515456    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:39:46.524006 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:46.523981    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:39:46.524253 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:46.524232    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:39:46.527306 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:46.527281    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 03:39:49.577405 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:49.577376    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-579ddf4cf5-6jqxk"
Jul 30 03:39:50.608725 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:50.608645    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f4f97b8d7-567vv"]
Jul 30 03:39:50.616286 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:50.616160    2571 patch_prober.go:28] interesting pod/image-registry-5f4f97b8d7-567vv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 30 03:39:50.616286 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:50.616235    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv" podUID="49890e4c-9bb3-4d2d-bc62-b68917281161" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 03:39:51.686433 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.686394    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5486575b67-lzssg"]
Jul 30 03:39:51.690761 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.690735    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.696190 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.695270    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qwnxn\""
Jul 30 03:39:51.696190 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.695964    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 03:39:51.696190 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.696174    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 03:39:51.696433 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.696204    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 03:39:51.696433 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.696246    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 03:39:51.697182 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.697063    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 03:39:51.700870 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.700851    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 30 03:39:51.706097 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.706074    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5486575b67-lzssg"]
Jul 30 03:39:51.862505 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.862464    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-config\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.862505 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.862516    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-oauth-config\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.862794 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.862558    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzljj\" (UniqueName: \"kubernetes.io/projected/edad0e62-0dcf-4f0e-980c-5d3286777e3f-kube-api-access-bzljj\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.862794 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.862586    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-trusted-ca-bundle\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.862794 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.862659    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-serving-cert\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.862794 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.862699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-oauth-serving-cert\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.862794 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.862774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-service-ca\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.963767 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.963686    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-config\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.963767 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.963737    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-oauth-config\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.963767 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.963764    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzljj\" (UniqueName: \"kubernetes.io/projected/edad0e62-0dcf-4f0e-980c-5d3286777e3f-kube-api-access-bzljj\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.964045 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.963799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-trusted-ca-bundle\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.964045 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.963825    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-serving-cert\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.964045 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.963852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-oauth-serving-cert\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.964045 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.964006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-service-ca\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.964759 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.964726    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-config\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.964759 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.964752    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-service-ca\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.964962 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.964811    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-trusted-ca-bundle\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.965212 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.965178    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-oauth-serving-cert\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.967014 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.966941    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-oauth-config\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.967301 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.967277    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-serving-cert\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:51.973265 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:51.973246    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzljj\" (UniqueName: \"kubernetes.io/projected/edad0e62-0dcf-4f0e-980c-5d3286777e3f-kube-api-access-bzljj\") pod \"console-5486575b67-lzssg\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") " pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:52.004374 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:52.004332    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:39:52.635591 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:52.635552    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:39:55.555752 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:55.555724    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5486575b67-lzssg"]
Jul 30 03:39:55.558262 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:39:55.558234    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedad0e62_0dcf_4f0e_980c_5d3286777e3f.slice/crio-e8b9ed55f95edef5375553a5670fa16c75c16fd48af0cff18e1694905baad938 WatchSource:0}: Error finding container e8b9ed55f95edef5375553a5670fa16c75c16fd48af0cff18e1694905baad938: Status 404 returned error can't find the container with id e8b9ed55f95edef5375553a5670fa16c75c16fd48af0cff18e1694905baad938
Jul 30 03:39:55.560152 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:55.560135    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 03:39:55.619640 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:55.619603    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5486575b67-lzssg" event={"ID":"edad0e62-0dcf-4f0e-980c-5d3286777e3f","Type":"ContainerStarted","Data":"e8b9ed55f95edef5375553a5670fa16c75c16fd48af0cff18e1694905baad938"}
Jul 30 03:39:56.627590 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:56.627544    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-kh85j" event={"ID":"0cdbf51a-6c68-4713-9153-8efba2922d4f","Type":"ContainerStarted","Data":"86aff67c40d1a302eeda32008a9a073cf81b85b6f620b0e594833067c1b82847"}
Jul 30 03:39:56.628493 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:56.628428    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-kh85j"
Jul 30 03:39:56.649275 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:56.649216    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-kh85j" podStartSLOduration=1.9185822670000001 podStartE2EDuration="21.649193908s" totalImagesPullingTime="19.730611641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:39:56.646191859 +0000 UTC m=+310.485099148" watchObservedRunningTime="2026-07-30 03:39:56.649193908 +0000 UTC m=+310.488101196"
Jul 30 03:39:56.649593 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:39:56.649570    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-kh85j"
Jul 30 03:40:00.615714 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:00.615677    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:40:00.648010 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:00.647951    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5486575b67-lzssg" event={"ID":"edad0e62-0dcf-4f0e-980c-5d3286777e3f","Type":"ContainerStarted","Data":"f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867"}
Jul 30 03:40:00.665629 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:00.665571    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5486575b67-lzssg" podStartSLOduration=5.501358244 podStartE2EDuration="9.665547721s" totalImagesPullingTime="4.164189477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:40:00.6650255 +0000 UTC m=+314.503932778" watchObservedRunningTime="2026-07-30 03:40:00.665547721 +0000 UTC m=+314.504455009"
Jul 30 03:40:02.005202 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:02.005116    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:40:02.005202 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:02.005197    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:40:02.011210 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:02.011180    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:40:02.660698 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:02.660666    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:40:11.692015 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:11.691979    2571 generic.go:356] "Generic (PLEG): container finished" podID="77ba57ce-96dd-4028-b187-411bd28f7dc0" containerID="3759739e8fe35399a7af19111750e31948b1aa7846b80b71417006ffda033e3c" exitCode=0
Jul 30 03:40:11.692589 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:11.692051    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv" event={"ID":"77ba57ce-96dd-4028-b187-411bd28f7dc0","Type":"ContainerDied","Data":"3759739e8fe35399a7af19111750e31948b1aa7846b80b71417006ffda033e3c"}
Jul 30 03:40:11.692589 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:11.692362    2571 scope.go:117] "RemoveContainer" containerID="3759739e8fe35399a7af19111750e31948b1aa7846b80b71417006ffda033e3c"
Jul 30 03:40:12.699749 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:12.699698    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv" event={"ID":"77ba57ce-96dd-4028-b187-411bd28f7dc0","Type":"ContainerStarted","Data":"ae1e1bf226da511f2449b445aa03990737a70400f06221c2d24e86e48e47a8cb"}
Jul 30 03:40:15.637020 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.636953    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv" podUID="49890e4c-9bb3-4d2d-bc62-b68917281161" containerName="registry" containerID="cri-o://2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d" gracePeriod=30
Jul 30 03:40:15.928331 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.928297    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:40:15.990793 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.990755    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-certificates\") pod \"49890e4c-9bb3-4d2d-bc62-b68917281161\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") "
Jul 30 03:40:15.990955 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.990812    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-bound-sa-token\") pod \"49890e4c-9bb3-4d2d-bc62-b68917281161\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") "
Jul 30 03:40:15.990955 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.990848    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49890e4c-9bb3-4d2d-bc62-b68917281161-ca-trust-extracted\") pod \"49890e4c-9bb3-4d2d-bc62-b68917281161\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") "
Jul 30 03:40:15.990955 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.990904    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-installation-pull-secrets\") pod \"49890e4c-9bb3-4d2d-bc62-b68917281161\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") "
Jul 30 03:40:15.990955 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.990933    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-image-registry-private-configuration\") pod \"49890e4c-9bb3-4d2d-bc62-b68917281161\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") "
Jul 30 03:40:15.991130 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.990956    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") pod \"49890e4c-9bb3-4d2d-bc62-b68917281161\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") "
Jul 30 03:40:15.991130 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.991014    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-trusted-ca\") pod \"49890e4c-9bb3-4d2d-bc62-b68917281161\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") "
Jul 30 03:40:15.991130 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.991052    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v2zs\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-kube-api-access-7v2zs\") pod \"49890e4c-9bb3-4d2d-bc62-b68917281161\" (UID: \"49890e4c-9bb3-4d2d-bc62-b68917281161\") "
Jul 30 03:40:15.991272 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.991238    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "49890e4c-9bb3-4d2d-bc62-b68917281161" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:40:15.991672 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.991334    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-certificates\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:40:15.991672 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.991617    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "49890e4c-9bb3-4d2d-bc62-b68917281161" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:40:15.993708 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.993675    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "49890e4c-9bb3-4d2d-bc62-b68917281161" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:40:15.993816 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.993732    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-kube-api-access-7v2zs" (OuterVolumeSpecName: "kube-api-access-7v2zs") pod "49890e4c-9bb3-4d2d-bc62-b68917281161" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161"). InnerVolumeSpecName "kube-api-access-7v2zs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:40:15.993816 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.993804    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "49890e4c-9bb3-4d2d-bc62-b68917281161" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:40:15.993910 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.993832    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "49890e4c-9bb3-4d2d-bc62-b68917281161" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:40:15.993910 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:15.993839    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "49890e4c-9bb3-4d2d-bc62-b68917281161" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:40:16.000594 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.000569    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49890e4c-9bb3-4d2d-bc62-b68917281161-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "49890e4c-9bb3-4d2d-bc62-b68917281161" (UID: "49890e4c-9bb3-4d2d-bc62-b68917281161"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 03:40:16.092661 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.092625    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-bound-sa-token\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:40:16.092661 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.092656    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49890e4c-9bb3-4d2d-bc62-b68917281161-ca-trust-extracted\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:40:16.092661 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.092667    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-installation-pull-secrets\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:40:16.092849 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.092677    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49890e4c-9bb3-4d2d-bc62-b68917281161-image-registry-private-configuration\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:40:16.092849 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.092687    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-registry-tls\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:40:16.092849 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.092695    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49890e4c-9bb3-4d2d-bc62-b68917281161-trusted-ca\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:40:16.092849 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.092703    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v2zs\" (UniqueName: \"kubernetes.io/projected/49890e4c-9bb3-4d2d-bc62-b68917281161-kube-api-access-7v2zs\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:40:16.715426 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.715386    2571 generic.go:356] "Generic (PLEG): container finished" podID="49890e4c-9bb3-4d2d-bc62-b68917281161" containerID="2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d" exitCode=0
Jul 30 03:40:16.715857 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.715434    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv"
Jul 30 03:40:16.715857 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.715477    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv" event={"ID":"49890e4c-9bb3-4d2d-bc62-b68917281161","Type":"ContainerDied","Data":"2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d"}
Jul 30 03:40:16.715857 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.715543    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f4f97b8d7-567vv" event={"ID":"49890e4c-9bb3-4d2d-bc62-b68917281161","Type":"ContainerDied","Data":"11e422b042f9d5f1aca49f2b1dee715a203ea59d7f0c525f8bf11ce2068dee2e"}
Jul 30 03:40:16.715857 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.715565    2571 scope.go:117] "RemoveContainer" containerID="2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d"
Jul 30 03:40:16.723793 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.723773    2571 scope.go:117] "RemoveContainer" containerID="2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d"
Jul 30 03:40:16.724106 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:40:16.724085    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d\": container with ID starting with 2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d not found: ID does not exist" containerID="2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d"
Jul 30 03:40:16.724179 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.724119    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d"} err="failed to get container status \"2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d\": rpc error: code = NotFound desc = could not find container \"2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d\": container with ID starting with 2c7f2d593126fadfbe3c5d97764300fbcccc2fb7f722c943e2d7bf964589a47d not found: ID does not exist"
Jul 30 03:40:16.734166 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.734138    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f4f97b8d7-567vv"]
Jul 30 03:40:16.738996 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:16.738971    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f4f97b8d7-567vv"]
Jul 30 03:40:17.721415 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:17.721374    2571 generic.go:356] "Generic (PLEG): container finished" podID="6b42a150-6153-4428-9e0b-e13307f18e96" containerID="76f24928e0ecf568475f04194c876d6c8626b38416328ec0dfd19e5c9a0a7ffc" exitCode=0
Jul 30 03:40:17.721980 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:17.721447    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jkcpc" event={"ID":"6b42a150-6153-4428-9e0b-e13307f18e96","Type":"ContainerDied","Data":"76f24928e0ecf568475f04194c876d6c8626b38416328ec0dfd19e5c9a0a7ffc"}
Jul 30 03:40:17.721980 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:17.721858    2571 scope.go:117] "RemoveContainer" containerID="76f24928e0ecf568475f04194c876d6c8626b38416328ec0dfd19e5c9a0a7ffc"
Jul 30 03:40:18.640181 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:18.640149    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49890e4c-9bb3-4d2d-bc62-b68917281161" path="/var/lib/kubelet/pods/49890e4c-9bb3-4d2d-bc62-b68917281161/volumes"
Jul 30 03:40:18.682970 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:18.682935    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8558776bb7-zts8f_90ba3f14-0f5d-4fb7-a723-774259f302e7/router/0.log"
Jul 30 03:40:18.696179 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:18.696151    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l9dpx_2d51a280-0b63-42bc-9cf0-c5cb62ec8789/serve-healthcheck-canary/0.log"
Jul 30 03:40:18.728239 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:40:18.728210    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-jkcpc" event={"ID":"6b42a150-6153-4428-9e0b-e13307f18e96","Type":"ContainerStarted","Data":"4f37080684976add60848b1ba07db6e56433ecbcaac61aee89ad603ceebe447c"}
Jul 30 03:41:00.543909 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:00.543863    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:41:00.546223 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:00.546196    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359-metrics-certs\") pod \"network-metrics-daemon-9tdmg\" (UID: \"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359\") " pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:41:00.739438 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:00.739398    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvtgp\""
Jul 30 03:41:00.746719 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:00.746685    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9tdmg"
Jul 30 03:41:00.879641 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:00.879606    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9tdmg"]
Jul 30 03:41:00.903356 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:00.903318    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9tdmg" event={"ID":"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359","Type":"ContainerStarted","Data":"814a28c41da55b0d21653c213c8ec4b9e5efdd1dfca309a7ccb093fd12f130aa"}
Jul 30 03:41:02.912964 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:02.912929    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9tdmg" event={"ID":"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359","Type":"ContainerStarted","Data":"7359b81f6034bdfc0bda463278717779af91ba69cf9a01d305341727047313e1"}
Jul 30 03:41:02.913460 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:02.912988    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9tdmg" event={"ID":"b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359","Type":"ContainerStarted","Data":"ddb3088acf2a8bea811c5b74ec8d2cef59f5d8f3fef7a61fe4ffd6563559291c"}
Jul 30 03:41:02.932581 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:02.932514    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9tdmg" podStartSLOduration=375.789809397 podStartE2EDuration="6m16.932497055s" totalImagesPullingTime="1.142687658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:41:02.930019383 +0000 UTC m=+376.768926671" watchObservedRunningTime="2026-07-30 03:41:02.932497055 +0000 UTC m=+376.771404342"
Jul 30 03:41:15.505602 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:15.505565    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5486575b67-lzssg"]
Jul 30 03:41:40.527794 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.527752    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5486575b67-lzssg" podUID="edad0e62-0dcf-4f0e-980c-5d3286777e3f" containerName="console" containerID="cri-o://f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867" gracePeriod=15
Jul 30 03:41:40.769685 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.769661    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:41:40.863635 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.863545    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzljj\" (UniqueName: \"kubernetes.io/projected/edad0e62-0dcf-4f0e-980c-5d3286777e3f-kube-api-access-bzljj\") pod \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") "
Jul 30 03:41:40.863635 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.863597    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-serving-cert\") pod \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") "
Jul 30 03:41:40.863832 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.863646    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-oauth-serving-cert\") pod \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") "
Jul 30 03:41:40.863832 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.863801    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-service-ca\") pod \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") "
Jul 30 03:41:40.863930 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.863852    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-trusted-ca-bundle\") pod \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") "
Jul 30 03:41:40.863930 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.863880    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-config\") pod \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") "
Jul 30 03:41:40.863930 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.863918    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-oauth-config\") pod \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\" (UID: \"edad0e62-0dcf-4f0e-980c-5d3286777e3f\") "
Jul 30 03:41:40.864108 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.864021    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "edad0e62-0dcf-4f0e-980c-5d3286777e3f" (UID: "edad0e62-0dcf-4f0e-980c-5d3286777e3f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:41:40.864172 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.864147    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-oauth-serving-cert\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:41:40.864240 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.864208    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-service-ca" (OuterVolumeSpecName: "service-ca") pod "edad0e62-0dcf-4f0e-980c-5d3286777e3f" (UID: "edad0e62-0dcf-4f0e-980c-5d3286777e3f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:41:40.864294 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.864234    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "edad0e62-0dcf-4f0e-980c-5d3286777e3f" (UID: "edad0e62-0dcf-4f0e-980c-5d3286777e3f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:41:40.864368 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.864281    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-config" (OuterVolumeSpecName: "console-config") pod "edad0e62-0dcf-4f0e-980c-5d3286777e3f" (UID: "edad0e62-0dcf-4f0e-980c-5d3286777e3f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 03:41:40.865977 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.865945    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "edad0e62-0dcf-4f0e-980c-5d3286777e3f" (UID: "edad0e62-0dcf-4f0e-980c-5d3286777e3f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:41:40.866069 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.865999    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edad0e62-0dcf-4f0e-980c-5d3286777e3f-kube-api-access-bzljj" (OuterVolumeSpecName: "kube-api-access-bzljj") pod "edad0e62-0dcf-4f0e-980c-5d3286777e3f" (UID: "edad0e62-0dcf-4f0e-980c-5d3286777e3f"). InnerVolumeSpecName "kube-api-access-bzljj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 03:41:40.866069 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.866000    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "edad0e62-0dcf-4f0e-980c-5d3286777e3f" (UID: "edad0e62-0dcf-4f0e-980c-5d3286777e3f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 03:41:40.965223 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.965182    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-service-ca\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:41:40.965223 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.965216    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-trusted-ca-bundle\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:41:40.965223 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.965225    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-config\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:41:40.965223 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.965234    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-oauth-config\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:41:40.965500 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.965242    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzljj\" (UniqueName: \"kubernetes.io/projected/edad0e62-0dcf-4f0e-980c-5d3286777e3f-kube-api-access-bzljj\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:41:40.965500 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:40.965251    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/edad0e62-0dcf-4f0e-980c-5d3286777e3f-console-serving-cert\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 03:41:41.056453 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:41.056412    2571 generic.go:356] "Generic (PLEG): container finished" podID="edad0e62-0dcf-4f0e-980c-5d3286777e3f" containerID="f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867" exitCode=0
Jul 30 03:41:41.056630 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:41.056464    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5486575b67-lzssg"
Jul 30 03:41:41.056630 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:41.056494    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5486575b67-lzssg" event={"ID":"edad0e62-0dcf-4f0e-980c-5d3286777e3f","Type":"ContainerDied","Data":"f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867"}
Jul 30 03:41:41.056630 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:41.056557    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5486575b67-lzssg" event={"ID":"edad0e62-0dcf-4f0e-980c-5d3286777e3f","Type":"ContainerDied","Data":"e8b9ed55f95edef5375553a5670fa16c75c16fd48af0cff18e1694905baad938"}
Jul 30 03:41:41.056630 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:41.056577    2571 scope.go:117] "RemoveContainer" containerID="f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867"
Jul 30 03:41:41.065797 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:41.065779    2571 scope.go:117] "RemoveContainer" containerID="f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867"
Jul 30 03:41:41.066075 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:41:41.066054    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867\": container with ID starting with f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867 not found: ID does not exist" containerID="f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867"
Jul 30 03:41:41.066122 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:41.066084    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867"} err="failed to get container status \"f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867\": rpc error: code = NotFound desc = could not find container \"f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867\": container with ID starting with f5ebb1d657cbf3d73d2a1d9e167c82235b404ddac639fd15e34c508aaa52b867 not found: ID does not exist"
Jul 30 03:41:41.077871 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:41.077838    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5486575b67-lzssg"]
Jul 30 03:41:41.081233 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:41.081207    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5486575b67-lzssg"]
Jul 30 03:41:42.640328 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:41:42.640291    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edad0e62-0dcf-4f0e-980c-5d3286777e3f" path="/var/lib/kubelet/pods/edad0e62-0dcf-4f0e-980c-5d3286777e3f/volumes"
Jul 30 03:42:26.294163 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.294079    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv"]
Jul 30 03:42:26.294680 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.294362    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49890e4c-9bb3-4d2d-bc62-b68917281161" containerName="registry"
Jul 30 03:42:26.294680 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.294373    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="49890e4c-9bb3-4d2d-bc62-b68917281161" containerName="registry"
Jul 30 03:42:26.294680 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.294387    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edad0e62-0dcf-4f0e-980c-5d3286777e3f" containerName="console"
Jul 30 03:42:26.294680 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.294392    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="edad0e62-0dcf-4f0e-980c-5d3286777e3f" containerName="console"
Jul 30 03:42:26.294680 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.294437    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="edad0e62-0dcf-4f0e-980c-5d3286777e3f" containerName="console"
Jul 30 03:42:26.294680 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.294445    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="49890e4c-9bb3-4d2d-bc62-b68917281161" containerName="registry"
Jul 30 03:42:26.296208 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.296192    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv"
Jul 30 03:42:26.298747 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.298725    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 30 03:42:26.298854 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.298798    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 30 03:42:26.298854 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.298809    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nzfnw\""
Jul 30 03:42:26.311934 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.311900    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv"]
Jul 30 03:42:26.423090 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.423051    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1282435f-a59a-460e-8f9e-e9c01f8720b1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7d4pv\" (UID: \"1282435f-a59a-460e-8f9e-e9c01f8720b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv"
Jul 30 03:42:26.423265 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.423102    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5ttt\" (UniqueName: \"kubernetes.io/projected/1282435f-a59a-460e-8f9e-e9c01f8720b1-kube-api-access-h5ttt\") pod \"cert-manager-operator-controller-manager-55c444bf86-7d4pv\" (UID: \"1282435f-a59a-460e-8f9e-e9c01f8720b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv"
Jul 30 03:42:26.523904 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.523867    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1282435f-a59a-460e-8f9e-e9c01f8720b1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7d4pv\" (UID: \"1282435f-a59a-460e-8f9e-e9c01f8720b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv"
Jul 30 03:42:26.524081 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.523916    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5ttt\" (UniqueName: \"kubernetes.io/projected/1282435f-a59a-460e-8f9e-e9c01f8720b1-kube-api-access-h5ttt\") pod \"cert-manager-operator-controller-manager-55c444bf86-7d4pv\" (UID: \"1282435f-a59a-460e-8f9e-e9c01f8720b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv"
Jul 30 03:42:26.524270 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.524249    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1282435f-a59a-460e-8f9e-e9c01f8720b1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7d4pv\" (UID: \"1282435f-a59a-460e-8f9e-e9c01f8720b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv"
Jul 30 03:42:26.534373 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.534350    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5ttt\" (UniqueName: \"kubernetes.io/projected/1282435f-a59a-460e-8f9e-e9c01f8720b1-kube-api-access-h5ttt\") pod \"cert-manager-operator-controller-manager-55c444bf86-7d4pv\" (UID: \"1282435f-a59a-460e-8f9e-e9c01f8720b1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv"
Jul 30 03:42:26.605426 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.605318    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv"
Jul 30 03:42:26.739332 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:26.739300    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv"]
Jul 30 03:42:26.746491 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:42:26.746456    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1282435f_a59a_460e_8f9e_e9c01f8720b1.slice/crio-e9c144e5fb2e5b51fefbc31e1b0614fe291d6b7937d5e6279452745563d1861e WatchSource:0}: Error finding container e9c144e5fb2e5b51fefbc31e1b0614fe291d6b7937d5e6279452745563d1861e: Status 404 returned error can't find the container with id e9c144e5fb2e5b51fefbc31e1b0614fe291d6b7937d5e6279452745563d1861e
Jul 30 03:42:27.225375 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:27.225333    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv" event={"ID":"1282435f-a59a-460e-8f9e-e9c01f8720b1","Type":"ContainerStarted","Data":"e9c144e5fb2e5b51fefbc31e1b0614fe291d6b7937d5e6279452745563d1861e"}
Jul 30 03:42:30.242240 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.242202    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv" event={"ID":"1282435f-a59a-460e-8f9e-e9c01f8720b1","Type":"ContainerStarted","Data":"30bbbc51bab8e13afde20f6651ed84704a70cdad6595af4d293d92548bdd753c"}
Jul 30 03:42:30.262787 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.262709    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7d4pv" podStartSLOduration=1.236174418 podStartE2EDuration="4.262696135s" totalImagesPullingTime="3.026521717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:42:30.262433749 +0000 UTC m=+464.101341035" watchObservedRunningTime="2026-07-30 03:42:30.262696135 +0000 UTC m=+464.101603423"
Jul 30 03:42:30.599337 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.599259    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-spkq4"]
Jul 30 03:42:30.601493 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.601472    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4"
Jul 30 03:42:30.605052 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.605030    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-prft7\""
Jul 30 03:42:30.605477 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.605455    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 30 03:42:30.605595 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.605575    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 30 03:42:30.630370 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.630342    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-spkq4"]
Jul 30 03:42:30.659305 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.659275    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b20fd1e-14fb-4035-b1c3-d1a09d0960c6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-spkq4\" (UID: \"1b20fd1e-14fb-4035-b1c3-d1a09d0960c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4"
Jul 30 03:42:30.659458 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.659342    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csbw5\" (UniqueName: \"kubernetes.io/projected/1b20fd1e-14fb-4035-b1c3-d1a09d0960c6-kube-api-access-csbw5\") pod \"cert-manager-webhook-6486ffd997-spkq4\" (UID: \"1b20fd1e-14fb-4035-b1c3-d1a09d0960c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4"
Jul 30 03:42:30.760060 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.760006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b20fd1e-14fb-4035-b1c3-d1a09d0960c6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-spkq4\" (UID: \"1b20fd1e-14fb-4035-b1c3-d1a09d0960c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4"
Jul 30 03:42:30.760060 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.760068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csbw5\" (UniqueName: \"kubernetes.io/projected/1b20fd1e-14fb-4035-b1c3-d1a09d0960c6-kube-api-access-csbw5\") pod \"cert-manager-webhook-6486ffd997-spkq4\" (UID: \"1b20fd1e-14fb-4035-b1c3-d1a09d0960c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4"
Jul 30 03:42:30.775669 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.775637    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csbw5\" (UniqueName: \"kubernetes.io/projected/1b20fd1e-14fb-4035-b1c3-d1a09d0960c6-kube-api-access-csbw5\") pod \"cert-manager-webhook-6486ffd997-spkq4\" (UID: \"1b20fd1e-14fb-4035-b1c3-d1a09d0960c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4"
Jul 30 03:42:30.776660 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.776639    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b20fd1e-14fb-4035-b1c3-d1a09d0960c6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-spkq4\" (UID: \"1b20fd1e-14fb-4035-b1c3-d1a09d0960c6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4"
Jul 30 03:42:30.921243 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:30.921203    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4"
Jul 30 03:42:31.057412 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:31.057381    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-spkq4"]
Jul 30 03:42:31.060505 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:42:31.060485    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b20fd1e_14fb_4035_b1c3_d1a09d0960c6.slice/crio-00a366bc7868aef360cdba5bed8ec3167ce86e74bb971e7f5e340d4321f14a93 WatchSource:0}: Error finding container 00a366bc7868aef360cdba5bed8ec3167ce86e74bb971e7f5e340d4321f14a93: Status 404 returned error can't find the container with id 00a366bc7868aef360cdba5bed8ec3167ce86e74bb971e7f5e340d4321f14a93
Jul 30 03:42:31.249000 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:31.248911    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4" event={"ID":"1b20fd1e-14fb-4035-b1c3-d1a09d0960c6","Type":"ContainerStarted","Data":"00a366bc7868aef360cdba5bed8ec3167ce86e74bb971e7f5e340d4321f14a93"}
Jul 30 03:42:33.033485 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:33.033448    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b"]
Jul 30 03:42:33.035886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:33.035864    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b"
Jul 30 03:42:33.038300 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:33.038277    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4ggrf\""
Jul 30 03:42:33.047579 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:33.047552    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b"]
Jul 30 03:42:33.180510 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:33.180471    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57c2673a-7c8c-46ee-b734-9a166d0db651-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5mk8b\" (UID: \"57c2673a-7c8c-46ee-b734-9a166d0db651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b"
Jul 30 03:42:33.180699 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:33.180606    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8qx7\" (UniqueName: \"kubernetes.io/projected/57c2673a-7c8c-46ee-b734-9a166d0db651-kube-api-access-m8qx7\") pod \"cert-manager-cainjector-559cdd8c87-5mk8b\" (UID: \"57c2673a-7c8c-46ee-b734-9a166d0db651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b"
Jul 30 03:42:33.281742 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:33.281682    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57c2673a-7c8c-46ee-b734-9a166d0db651-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5mk8b\" (UID: \"57c2673a-7c8c-46ee-b734-9a166d0db651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b"
Jul 30 03:42:33.281935 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:33.281783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8qx7\" (UniqueName: \"kubernetes.io/projected/57c2673a-7c8c-46ee-b734-9a166d0db651-kube-api-access-m8qx7\") pod \"cert-manager-cainjector-559cdd8c87-5mk8b\" (UID: \"57c2673a-7c8c-46ee-b734-9a166d0db651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b"
Jul 30 03:42:33.290766 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:33.290679    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57c2673a-7c8c-46ee-b734-9a166d0db651-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5mk8b\" (UID: \"57c2673a-7c8c-46ee-b734-9a166d0db651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b"
Jul 30 03:42:33.290931 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:33.290796    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8qx7\" (UniqueName: \"kubernetes.io/projected/57c2673a-7c8c-46ee-b734-9a166d0db651-kube-api-access-m8qx7\") pod \"cert-manager-cainjector-559cdd8c87-5mk8b\" (UID: \"57c2673a-7c8c-46ee-b734-9a166d0db651\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b"
Jul 30 03:42:33.347582 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:33.347545    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b"
Jul 30 03:42:34.104062 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:34.104032    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b"]
Jul 30 03:42:34.107075 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:42:34.107050    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57c2673a_7c8c_46ee_b734_9a166d0db651.slice/crio-88192abb8e6e1197570477a517e1be0eec0341358d7af770afad7ace4c7e3920 WatchSource:0}: Error finding container 88192abb8e6e1197570477a517e1be0eec0341358d7af770afad7ace4c7e3920: Status 404 returned error can't find the container with id 88192abb8e6e1197570477a517e1be0eec0341358d7af770afad7ace4c7e3920
Jul 30 03:42:34.263721 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:34.263616    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b" event={"ID":"57c2673a-7c8c-46ee-b734-9a166d0db651","Type":"ContainerStarted","Data":"65eb9c03272592cf08b96d9e9817b15018ce06be25cb786669efd8cc7ee7b92d"}
Jul 30 03:42:34.263721 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:34.263666    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b" event={"ID":"57c2673a-7c8c-46ee-b734-9a166d0db651","Type":"ContainerStarted","Data":"88192abb8e6e1197570477a517e1be0eec0341358d7af770afad7ace4c7e3920"}
Jul 30 03:42:34.265210 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:34.265182    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4" event={"ID":"1b20fd1e-14fb-4035-b1c3-d1a09d0960c6","Type":"ContainerStarted","Data":"b2f6876d8cc5959c7d035e0852ca74b13d91c7186587cfdb4dedd185a0c75570"}
Jul 30 03:42:34.265365 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:34.265234    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4"
Jul 30 03:42:34.281676 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:34.281623    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5mk8b" podStartSLOduration=1.281606915 podStartE2EDuration="1.281606915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:42:34.280634086 +0000 UTC m=+468.119541367" watchObservedRunningTime="2026-07-30 03:42:34.281606915 +0000 UTC m=+468.120514201"
Jul 30 03:42:34.299705 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:34.299658    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4" podStartSLOduration=1.34797761 podStartE2EDuration="4.29963849s" totalImagesPullingTime="2.95166088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:42:34.297491656 +0000 UTC m=+468.136398943" watchObservedRunningTime="2026-07-30 03:42:34.29963849 +0000 UTC m=+468.138545777"
Jul 30 03:42:40.271761 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:42:40.271726    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-spkq4"
Jul 30 03:43:01.626884 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.626847    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"]
Jul 30 03:43:01.630448 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.630426    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.633163 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.633140    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 03:43:01.634299 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.634277    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 03:43:01.634580 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.634564    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 03:43:01.634663 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.634568    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 03:43:01.634663 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.634625    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rfxwq\""
Jul 30 03:43:01.648821 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.648795    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"]
Jul 30 03:43:01.718170 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.718131    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d66d45a0-65ba-4f38-9400-22bd28fb0330-tmp\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.718375 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.718186    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d66d45a0-65ba-4f38-9400-22bd28fb0330-manifests\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.718375 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.718364    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d66d45a0-65ba-4f38-9400-22bd28fb0330-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.718552 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.718505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh9qs\" (UniqueName: \"kubernetes.io/projected/d66d45a0-65ba-4f38-9400-22bd28fb0330-kube-api-access-rh9qs\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.718604 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.718573    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d66d45a0-65ba-4f38-9400-22bd28fb0330-webhook-cert\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.819445 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.819406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d66d45a0-65ba-4f38-9400-22bd28fb0330-tmp\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.819621 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.819460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d66d45a0-65ba-4f38-9400-22bd28fb0330-manifests\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.819621 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.819503    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d66d45a0-65ba-4f38-9400-22bd28fb0330-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.819621 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.819521    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh9qs\" (UniqueName: \"kubernetes.io/projected/d66d45a0-65ba-4f38-9400-22bd28fb0330-kube-api-access-rh9qs\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.819621 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.819583    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d66d45a0-65ba-4f38-9400-22bd28fb0330-webhook-cert\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.819934 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.819898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d66d45a0-65ba-4f38-9400-22bd28fb0330-manifests\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.821963 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.821936    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d66d45a0-65ba-4f38-9400-22bd28fb0330-tmp\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.822066 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.821982    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d66d45a0-65ba-4f38-9400-22bd28fb0330-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.822066 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.822035    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d66d45a0-65ba-4f38-9400-22bd28fb0330-webhook-cert\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.830835 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.830811    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh9qs\" (UniqueName: \"kubernetes.io/projected/d66d45a0-65ba-4f38-9400-22bd28fb0330-kube-api-access-rh9qs\") pod \"opendatahub-operator-controller-manager-5946c6c8fb-gd5hx\" (UID: \"d66d45a0-65ba-4f38-9400-22bd28fb0330\") " pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:01.940913 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:01.940807    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:02.079949 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:02.079923    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"]
Jul 30 03:43:02.083280 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:43:02.083251    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66d45a0_65ba_4f38_9400_22bd28fb0330.slice/crio-d540d965a0c706ddb9c7dab7e38b40914af9c15fd0ce17660db1589ec56b2e53 WatchSource:0}: Error finding container d540d965a0c706ddb9c7dab7e38b40914af9c15fd0ce17660db1589ec56b2e53: Status 404 returned error can't find the container with id d540d965a0c706ddb9c7dab7e38b40914af9c15fd0ce17660db1589ec56b2e53
Jul 30 03:43:02.380421 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:02.380383    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx" event={"ID":"d66d45a0-65ba-4f38-9400-22bd28fb0330","Type":"ContainerStarted","Data":"d540d965a0c706ddb9c7dab7e38b40914af9c15fd0ce17660db1589ec56b2e53"}
Jul 30 03:43:05.396089 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:05.396053    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx" event={"ID":"d66d45a0-65ba-4f38-9400-22bd28fb0330","Type":"ContainerStarted","Data":"c1fb721ed302112c8b321b7e09142d2b6705e78b07a50ebb966c354fa16a7f86"}
Jul 30 03:43:07.405020 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:07.404982    2571 generic.go:356] "Generic (PLEG): container finished" podID="d66d45a0-65ba-4f38-9400-22bd28fb0330" containerID="c1fb721ed302112c8b321b7e09142d2b6705e78b07a50ebb966c354fa16a7f86" exitCode=0
Jul 30 03:43:07.405426 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:07.405059    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx" event={"ID":"d66d45a0-65ba-4f38-9400-22bd28fb0330","Type":"ContainerDied","Data":"c1fb721ed302112c8b321b7e09142d2b6705e78b07a50ebb966c354fa16a7f86"}
Jul 30 03:43:08.411266 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:08.411230    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx" event={"ID":"d66d45a0-65ba-4f38-9400-22bd28fb0330","Type":"ContainerStarted","Data":"8584c7a84edd1f82994b47f883f6db8e0498fce528f8b70d13c21271de1da8cb"}
Jul 30 03:43:08.411745 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:08.411481    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:08.433990 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:08.433937    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx" podStartSLOduration=2.779795601 podStartE2EDuration="7.433919473s" totalImagesPullingTime="3.574201361s" totalInitContainerRuntime="1.079922511s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:43:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:43:08.432185303 +0000 UTC m=+502.271092616" watchObservedRunningTime="2026-07-30 03:43:08.433919473 +0000 UTC m=+502.272826759"
Jul 30 03:43:19.419597 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:19.419562    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5946c6c8fb-gd5hx"
Jul 30 03:43:21.689813 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:21.689776    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xq4qk"]
Jul 30 03:43:21.696733 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:21.696711    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk"
Jul 30 03:43:21.700068 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:21.700044    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-d9mm7\""
Jul 30 03:43:21.700729 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:21.700710    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 30 03:43:21.706505 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:21.706482    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xq4qk"]
Jul 30 03:43:21.776055 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:21.776018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b6e2081-92e2-4a74-8d17-a28ae31b8223-cert\") pod \"odh-model-controller-7998c67dc4-xq4qk\" (UID: \"8b6e2081-92e2-4a74-8d17-a28ae31b8223\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk"
Jul 30 03:43:21.776228 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:21.776062    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng4l9\" (UniqueName: \"kubernetes.io/projected/8b6e2081-92e2-4a74-8d17-a28ae31b8223-kube-api-access-ng4l9\") pod \"odh-model-controller-7998c67dc4-xq4qk\" (UID: \"8b6e2081-92e2-4a74-8d17-a28ae31b8223\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk"
Jul 30 03:43:21.877119 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:21.877078    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b6e2081-92e2-4a74-8d17-a28ae31b8223-cert\") pod \"odh-model-controller-7998c67dc4-xq4qk\" (UID: \"8b6e2081-92e2-4a74-8d17-a28ae31b8223\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk"
Jul 30 03:43:21.877119 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:21.877121    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng4l9\" (UniqueName: \"kubernetes.io/projected/8b6e2081-92e2-4a74-8d17-a28ae31b8223-kube-api-access-ng4l9\") pod \"odh-model-controller-7998c67dc4-xq4qk\" (UID: \"8b6e2081-92e2-4a74-8d17-a28ae31b8223\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk"
Jul 30 03:43:21.877385 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:43:21.877240    2571 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 30 03:43:21.877385 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:43:21.877311    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b6e2081-92e2-4a74-8d17-a28ae31b8223-cert podName:8b6e2081-92e2-4a74-8d17-a28ae31b8223 nodeName:}" failed. No retries permitted until 2026-07-30 03:43:22.377291223 +0000 UTC m=+516.216198492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b6e2081-92e2-4a74-8d17-a28ae31b8223-cert") pod "odh-model-controller-7998c67dc4-xq4qk" (UID: "8b6e2081-92e2-4a74-8d17-a28ae31b8223") : secret "odh-model-controller-webhook-cert" not found
Jul 30 03:43:21.885651 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:21.885625    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng4l9\" (UniqueName: \"kubernetes.io/projected/8b6e2081-92e2-4a74-8d17-a28ae31b8223-kube-api-access-ng4l9\") pod \"odh-model-controller-7998c67dc4-xq4qk\" (UID: \"8b6e2081-92e2-4a74-8d17-a28ae31b8223\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk"
Jul 30 03:43:22.343267 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.343226    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sszn6"]
Jul 30 03:43:22.346619 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.346595    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sszn6"
Jul 30 03:43:22.348941 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.348918    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 30 03:43:22.349047 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.348953    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-mprcl\""
Jul 30 03:43:22.356834 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.356809    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sszn6"]
Jul 30 03:43:22.381716 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.381686    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b6e2081-92e2-4a74-8d17-a28ae31b8223-cert\") pod \"odh-model-controller-7998c67dc4-xq4qk\" (UID: \"8b6e2081-92e2-4a74-8d17-a28ae31b8223\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk"
Jul 30 03:43:22.384059 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.384031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b6e2081-92e2-4a74-8d17-a28ae31b8223-cert\") pod \"odh-model-controller-7998c67dc4-xq4qk\" (UID: \"8b6e2081-92e2-4a74-8d17-a28ae31b8223\") " pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk"
Jul 30 03:43:22.482232 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.482191    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79nq8\" (UniqueName: \"kubernetes.io/projected/d5db0a53-ee21-4b98-a9c4-ca614594d45c-kube-api-access-79nq8\") pod \"model-serving-api-54d89bd5fc-sszn6\" (UID: \"d5db0a53-ee21-4b98-a9c4-ca614594d45c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sszn6"
Jul 30 03:43:22.482393 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.482287    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5db0a53-ee21-4b98-a9c4-ca614594d45c-tls-certs\") pod \"model-serving-api-54d89bd5fc-sszn6\" (UID: \"d5db0a53-ee21-4b98-a9c4-ca614594d45c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sszn6"
Jul 30 03:43:22.583540 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.583498    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79nq8\" (UniqueName: \"kubernetes.io/projected/d5db0a53-ee21-4b98-a9c4-ca614594d45c-kube-api-access-79nq8\") pod \"model-serving-api-54d89bd5fc-sszn6\" (UID: \"d5db0a53-ee21-4b98-a9c4-ca614594d45c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sszn6"
Jul 30 03:43:22.583718 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.583585    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5db0a53-ee21-4b98-a9c4-ca614594d45c-tls-certs\") pod \"model-serving-api-54d89bd5fc-sszn6\" (UID: \"d5db0a53-ee21-4b98-a9c4-ca614594d45c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sszn6"
Jul 30 03:43:22.583718 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:43:22.583684    2571 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 30 03:43:22.583789 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:43:22.583737    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5db0a53-ee21-4b98-a9c4-ca614594d45c-tls-certs podName:d5db0a53-ee21-4b98-a9c4-ca614594d45c nodeName:}" failed. No retries permitted until 2026-07-30 03:43:23.083721944 +0000 UTC m=+516.922629209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d5db0a53-ee21-4b98-a9c4-ca614594d45c-tls-certs") pod "model-serving-api-54d89bd5fc-sszn6" (UID: "d5db0a53-ee21-4b98-a9c4-ca614594d45c") : secret "model-serving-api-tls" not found
Jul 30 03:43:22.599479 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.599407    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79nq8\" (UniqueName: \"kubernetes.io/projected/d5db0a53-ee21-4b98-a9c4-ca614594d45c-kube-api-access-79nq8\") pod \"model-serving-api-54d89bd5fc-sszn6\" (UID: \"d5db0a53-ee21-4b98-a9c4-ca614594d45c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sszn6"
Jul 30 03:43:22.607711 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.607689    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk"
Jul 30 03:43:22.739196 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:22.739171    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xq4qk"]
Jul 30 03:43:22.741896 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:43:22.741867    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6e2081_92e2_4a74_8d17_a28ae31b8223.slice/crio-7a45d2c1c85469cecbd6fb775e9e5acb0900fcc3cee79a9919d9d2e10c0ce806 WatchSource:0}: Error finding container 7a45d2c1c85469cecbd6fb775e9e5acb0900fcc3cee79a9919d9d2e10c0ce806: Status 404 returned error can't find the container with id 7a45d2c1c85469cecbd6fb775e9e5acb0900fcc3cee79a9919d9d2e10c0ce806
Jul 30 03:43:23.087515 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:23.087458    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5db0a53-ee21-4b98-a9c4-ca614594d45c-tls-certs\") pod \"model-serving-api-54d89bd5fc-sszn6\" (UID: \"d5db0a53-ee21-4b98-a9c4-ca614594d45c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sszn6"
Jul 30 03:43:23.089976 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:23.089945    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5db0a53-ee21-4b98-a9c4-ca614594d45c-tls-certs\") pod \"model-serving-api-54d89bd5fc-sszn6\" (UID: \"d5db0a53-ee21-4b98-a9c4-ca614594d45c\") " pod="opendatahub/model-serving-api-54d89bd5fc-sszn6"
Jul 30 03:43:23.258091 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:23.258047    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sszn6"
Jul 30 03:43:23.389623 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:23.389596    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sszn6"]
Jul 30 03:43:23.391993 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:43:23.391964    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5db0a53_ee21_4b98_a9c4_ca614594d45c.slice/crio-4eb671d9762c6a69771dcea0059bc55f9ff0bb76c120babc8832588ee9a7047e WatchSource:0}: Error finding container 4eb671d9762c6a69771dcea0059bc55f9ff0bb76c120babc8832588ee9a7047e: Status 404 returned error can't find the container with id 4eb671d9762c6a69771dcea0059bc55f9ff0bb76c120babc8832588ee9a7047e
Jul 30 03:43:23.478721 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:23.478685    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk" event={"ID":"8b6e2081-92e2-4a74-8d17-a28ae31b8223","Type":"ContainerStarted","Data":"7a45d2c1c85469cecbd6fb775e9e5acb0900fcc3cee79a9919d9d2e10c0ce806"}
Jul 30 03:43:23.479995 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:23.479958    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sszn6" event={"ID":"d5db0a53-ee21-4b98-a9c4-ca614594d45c","Type":"ContainerStarted","Data":"4eb671d9762c6a69771dcea0059bc55f9ff0bb76c120babc8832588ee9a7047e"}
Jul 30 03:43:26.496102 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.496060    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sszn6" event={"ID":"d5db0a53-ee21-4b98-a9c4-ca614594d45c","Type":"ContainerStarted","Data":"fb0edc3fb2a7a14349aaab361d622a69430125dffa5d1f39a29185e2a0181d4b"}
Jul 30 03:43:26.496576 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.496154    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-sszn6"
Jul 30 03:43:26.497431 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.497401    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk" event={"ID":"8b6e2081-92e2-4a74-8d17-a28ae31b8223","Type":"ContainerStarted","Data":"22246db26d5a9a134337e602787036012bd38c8c178c999091cf192199494e29"}
Jul 30 03:43:26.497498 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.497459    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk"
Jul 30 03:43:26.513368 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.513321    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-sszn6" podStartSLOduration=1.837995398 podStartE2EDuration="4.513306474s" totalImagesPullingTime="2.675311076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:43:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:43:26.511757214 +0000 UTC m=+520.350664502" watchObservedRunningTime="2026-07-30 03:43:26.513306474 +0000 UTC m=+520.352213761"
Jul 30 03:43:26.527100 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.527053    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk" podStartSLOduration=2.198453937 podStartE2EDuration="5.527038624s" totalImagesPullingTime="3.328584687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:43:26.525804377 +0000 UTC m=+520.364711675" watchObservedRunningTime="2026-07-30 03:43:26.527038624 +0000 UTC m=+520.365945910"
Jul 30 03:43:26.928260 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.928222    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"]
Jul 30 03:43:26.931463 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.931444    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:26.933933 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.933905    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 03:43:26.934048 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.933961    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 03:43:26.934126 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.934084    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-z496c\""
Jul 30 03:43:26.940541 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:26.940507    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"]
Jul 30 03:43:27.023412 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:27.023379    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b930714f-b7ee-4aa3-a830-1b3fc554a87a-tmp\") pod \"kube-auth-proxy-fb6bd797-4fslr\" (UID: \"b930714f-b7ee-4aa3-a830-1b3fc554a87a\") " pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:27.023412 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:27.023415    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b930714f-b7ee-4aa3-a830-1b3fc554a87a-tls-certs\") pod \"kube-auth-proxy-fb6bd797-4fslr\" (UID: \"b930714f-b7ee-4aa3-a830-1b3fc554a87a\") " pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:27.023667 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:27.023630    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trc5w\" (UniqueName: \"kubernetes.io/projected/b930714f-b7ee-4aa3-a830-1b3fc554a87a-kube-api-access-trc5w\") pod \"kube-auth-proxy-fb6bd797-4fslr\" (UID: \"b930714f-b7ee-4aa3-a830-1b3fc554a87a\") " pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:27.124870 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:27.124833    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b930714f-b7ee-4aa3-a830-1b3fc554a87a-tmp\") pod \"kube-auth-proxy-fb6bd797-4fslr\" (UID: \"b930714f-b7ee-4aa3-a830-1b3fc554a87a\") " pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:27.124870 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:27.124874    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b930714f-b7ee-4aa3-a830-1b3fc554a87a-tls-certs\") pod \"kube-auth-proxy-fb6bd797-4fslr\" (UID: \"b930714f-b7ee-4aa3-a830-1b3fc554a87a\") " pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:27.125045 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:27.124931    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trc5w\" (UniqueName: \"kubernetes.io/projected/b930714f-b7ee-4aa3-a830-1b3fc554a87a-kube-api-access-trc5w\") pod \"kube-auth-proxy-fb6bd797-4fslr\" (UID: \"b930714f-b7ee-4aa3-a830-1b3fc554a87a\") " pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:27.125045 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:43:27.125032    2571 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 30 03:43:27.125115 ip-10-0-136-241 kubenswrapper[2571]: E0730 03:43:27.125096    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b930714f-b7ee-4aa3-a830-1b3fc554a87a-tls-certs podName:b930714f-b7ee-4aa3-a830-1b3fc554a87a nodeName:}" failed. No retries permitted until 2026-07-30 03:43:27.625079278 +0000 UTC m=+521.463986543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b930714f-b7ee-4aa3-a830-1b3fc554a87a-tls-certs") pod "kube-auth-proxy-fb6bd797-4fslr" (UID: "b930714f-b7ee-4aa3-a830-1b3fc554a87a") : secret "kube-auth-proxy-tls" not found
Jul 30 03:43:27.126997 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:27.126976    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b930714f-b7ee-4aa3-a830-1b3fc554a87a-tmp\") pod \"kube-auth-proxy-fb6bd797-4fslr\" (UID: \"b930714f-b7ee-4aa3-a830-1b3fc554a87a\") " pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:27.135480 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:27.135455    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trc5w\" (UniqueName: \"kubernetes.io/projected/b930714f-b7ee-4aa3-a830-1b3fc554a87a-kube-api-access-trc5w\") pod \"kube-auth-proxy-fb6bd797-4fslr\" (UID: \"b930714f-b7ee-4aa3-a830-1b3fc554a87a\") " pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:27.630724 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:27.630690    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b930714f-b7ee-4aa3-a830-1b3fc554a87a-tls-certs\") pod \"kube-auth-proxy-fb6bd797-4fslr\" (UID: \"b930714f-b7ee-4aa3-a830-1b3fc554a87a\") " pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:27.633425 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:27.633399    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b930714f-b7ee-4aa3-a830-1b3fc554a87a-tls-certs\") pod \"kube-auth-proxy-fb6bd797-4fslr\" (UID: \"b930714f-b7ee-4aa3-a830-1b3fc554a87a\") " pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:27.840840 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:27.840802    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"
Jul 30 03:43:28.001398 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:28.001358    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fb6bd797-4fslr"]
Jul 30 03:43:28.003685 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:43:28.003653    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb930714f_b7ee_4aa3_a830_1b3fc554a87a.slice/crio-9b13defa47567db1ff1efc660465060163268e5be947ed6817d343f5e47b2789 WatchSource:0}: Error finding container 9b13defa47567db1ff1efc660465060163268e5be947ed6817d343f5e47b2789: Status 404 returned error can't find the container with id 9b13defa47567db1ff1efc660465060163268e5be947ed6817d343f5e47b2789
Jul 30 03:43:28.506987 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:28.506955    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr" event={"ID":"b930714f-b7ee-4aa3-a830-1b3fc554a87a","Type":"ContainerStarted","Data":"9b13defa47567db1ff1efc660465060163268e5be947ed6817d343f5e47b2789"}
Jul 30 03:43:29.342692 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.342652    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"]
Jul 30 03:43:29.346469 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.346442    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.349592 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.349504    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 30 03:43:29.349592 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.349542    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kw97h\""
Jul 30 03:43:29.350731 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.350706    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 30 03:43:29.350991 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.350974    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 03:43:29.351086 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.350976    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 30 03:43:29.359420 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.359388    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"]
Jul 30 03:43:29.446868 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.446815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62da92f4-9217-4985-8aa2-c5db796fc211-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.447056 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.446911    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62da92f4-9217-4985-8aa2-c5db796fc211-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.447056 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.446940    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62da92f4-9217-4985-8aa2-c5db796fc211-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.447056 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.446964    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk6ww\" (UniqueName: \"kubernetes.io/projected/62da92f4-9217-4985-8aa2-c5db796fc211-kube-api-access-xk6ww\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.447056 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.447005    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62da92f4-9217-4985-8aa2-c5db796fc211-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.447246 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.447111    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62da92f4-9217-4985-8aa2-c5db796fc211-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.447246 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.447153    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62da92f4-9217-4985-8aa2-c5db796fc211-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.548563 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.548507    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62da92f4-9217-4985-8aa2-c5db796fc211-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.548760 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.548572    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62da92f4-9217-4985-8aa2-c5db796fc211-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.548760 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.548700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk6ww\" (UniqueName: \"kubernetes.io/projected/62da92f4-9217-4985-8aa2-c5db796fc211-kube-api-access-xk6ww\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.548886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.548776    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62da92f4-9217-4985-8aa2-c5db796fc211-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.548886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.548828    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62da92f4-9217-4985-8aa2-c5db796fc211-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.548886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.548858    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62da92f4-9217-4985-8aa2-c5db796fc211-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.549039 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.548899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62da92f4-9217-4985-8aa2-c5db796fc211-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.549325 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.549239    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62da92f4-9217-4985-8aa2-c5db796fc211-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.551794 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.551772    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62da92f4-9217-4985-8aa2-c5db796fc211-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.551886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.551832    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62da92f4-9217-4985-8aa2-c5db796fc211-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.551886 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.551871    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62da92f4-9217-4985-8aa2-c5db796fc211-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.552037 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.551938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62da92f4-9217-4985-8aa2-c5db796fc211-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.575783 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.575740    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62da92f4-9217-4985-8aa2-c5db796fc211-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.576685 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.576655    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk6ww\" (UniqueName: \"kubernetes.io/projected/62da92f4-9217-4985-8aa2-c5db796fc211-kube-api-access-xk6ww\") pod \"istiod-openshift-gateway-5677ccb49b-wlhwj\" (UID: \"62da92f4-9217-4985-8aa2-c5db796fc211\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.658825 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.658740    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:29.829208 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:29.829168    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"]
Jul 30 03:43:30.376307 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:43:30.376270    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62da92f4_9217_4985_8aa2_c5db796fc211.slice/crio-84977d23ed1336699bacd1422ec074f5b4251be54d69493c5c533c5e59d0cdce WatchSource:0}: Error finding container 84977d23ed1336699bacd1422ec074f5b4251be54d69493c5c533c5e59d0cdce: Status 404 returned error can't find the container with id 84977d23ed1336699bacd1422ec074f5b4251be54d69493c5c533c5e59d0cdce
Jul 30 03:43:30.380822 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.380795    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"]
Jul 30 03:43:30.384001 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.383982    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.387804 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.387779    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 03:43:30.387960 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.387788    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9mn9q\""
Jul 30 03:43:30.387960 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.387835    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 03:43:30.387960 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.387904    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 03:43:30.387960 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.387852    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 03:43:30.388161 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.388128    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 03:43:30.396461 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.396439    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"]
Jul 30 03:43:30.458920 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.458887    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-cert\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.459059 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.458935    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nthd7\" (UniqueName: \"kubernetes.io/projected/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-kube-api-access-nthd7\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.459059 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.459023    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-metrics-cert\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.459152 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.459089    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-manager-config\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.519282 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.519242    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj" event={"ID":"62da92f4-9217-4985-8aa2-c5db796fc211","Type":"ContainerStarted","Data":"84977d23ed1336699bacd1422ec074f5b4251be54d69493c5c533c5e59d0cdce"}
Jul 30 03:43:30.520710 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.520684    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr" event={"ID":"b930714f-b7ee-4aa3-a830-1b3fc554a87a","Type":"ContainerStarted","Data":"e286199932629d961a9a75054f68064a703b622bd4eff52abb586b1dda683561"}
Jul 30 03:43:30.560207 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.560168    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-manager-config\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.560363 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.560238    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-cert\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.560363 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.560284    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nthd7\" (UniqueName: \"kubernetes.io/projected/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-kube-api-access-nthd7\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.560363 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.560331    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-metrics-cert\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.560920 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.560888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-manager-config\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.562865 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.562829    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-metrics-cert\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.563169 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.563137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-cert\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.565076 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.565031    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-fb6bd797-4fslr" podStartSLOduration=2.142380673 podStartE2EDuration="4.56501716s" totalImagesPullingTime="2.422636487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:43:30.563462494 +0000 UTC m=+524.402369807" watchObservedRunningTime="2026-07-30 03:43:30.56501716 +0000 UTC m=+524.403924448"
Jul 30 03:43:30.574008 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.573980    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nthd7\" (UniqueName: \"kubernetes.io/projected/0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47-kube-api-access-nthd7\") pod \"lws-controller-manager-6bb6c44f89-gjjrn\" (UID: \"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47\") " pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.694475 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.694383    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:30.835826 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:30.835797    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"]
Jul 30 03:43:30.837944 ip-10-0-136-241 kubenswrapper[2571]: W0730 03:43:30.837916    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5a8ed4_3a27_4d8f_8d04_61852b1f7c47.slice/crio-0404e40c56cc5282526d9b6b0b2135b61771c758588733daad3f220309313dee WatchSource:0}: Error finding container 0404e40c56cc5282526d9b6b0b2135b61771c758588733daad3f220309313dee: Status 404 returned error can't find the container with id 0404e40c56cc5282526d9b6b0b2135b61771c758588733daad3f220309313dee
Jul 30 03:43:31.527054 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:31.527006    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn" event={"ID":"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47","Type":"ContainerStarted","Data":"0404e40c56cc5282526d9b6b0b2135b61771c758588733daad3f220309313dee"}
Jul 30 03:43:32.906287 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:32.906246    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 03:43:32.906684 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:32.906328    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 03:43:33.539996 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:33.539961    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj" event={"ID":"62da92f4-9217-4985-8aa2-c5db796fc211","Type":"ContainerStarted","Data":"70f999782d40343866cfd6246810139c37327b63d9b1d6428754dba801eccdf0"}
Jul 30 03:43:33.540184 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:33.540163    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:33.541937 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:33.541909    2571 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-wlhwj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 03:43:33.542063 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:33.541962    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj" podUID="62da92f4-9217-4985-8aa2-c5db796fc211" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 03:43:33.564613 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:33.564553    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj" podStartSLOduration=2.036783844 podStartE2EDuration="4.564510439s" totalImagesPullingTime="2.527726595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:43:33.562434137 +0000 UTC m=+527.401341426" watchObservedRunningTime="2026-07-30 03:43:33.564510439 +0000 UTC m=+527.403417726"
Jul 30 03:43:34.545658 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:34.545626    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wlhwj"
Jul 30 03:43:35.551321 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:35.551286    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn" event={"ID":"0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47","Type":"ContainerStarted","Data":"f9c1c774375e928b6154dbe341ea9ab8b41d088d7e36061ec59639b337a081a3"}
Jul 30 03:43:35.551790 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:35.551630    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:43:35.574991 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:35.574916    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn" podStartSLOduration=0.951658106 podStartE2EDuration="5.574894257s" totalImagesPullingTime="4.623236151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 03:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 03:43:35.574295358 +0000 UTC m=+529.413202649" watchObservedRunningTime="2026-07-30 03:43:35.574894257 +0000 UTC m=+529.413801545"
Jul 30 03:43:37.504544 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:37.504499    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xq4qk"
Jul 30 03:43:37.506396 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:37.506371    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-sszn6"
Jul 30 03:43:46.559302 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:43:46.559272    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bb6c44f89-gjjrn"
Jul 30 03:44:46.543929 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:44:46.543899    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:44:46.546311 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:44:46.546280    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:44:46.551578 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:44:46.551560    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:44:46.553568 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:44:46.553548    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:49:46.571947 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:49:46.571917    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:49:46.574680 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:49:46.574657    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:49:46.580114 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:49:46.580090    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:49:46.582156 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:49:46.582134    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:54:46.599342 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:54:46.599308    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:54:46.603235 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:54:46.603210    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:54:46.606744 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:54:46.606721    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:54:46.610476 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:54:46.610458    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:59:46.626629 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:59:46.626596    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:59:46.631377 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:59:46.631355    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 03:59:46.632921 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:59:46.632899    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 03:59:46.642086 ip-10-0-136-241 kubenswrapper[2571]: I0730 03:59:46.642063    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:04:46.651510 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:04:46.651480    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:04:46.657877 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:04:46.657851    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:04:46.661871 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:04:46.661852    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:04:46.668117 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:04:46.668099    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:09:46.677008 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:09:46.676978    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:09:46.684807 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:09:46.684478    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:09:46.691414 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:09:46.691383    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:09:46.698722 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:09:46.698695    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:14:46.703672 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:14:46.703644    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:14:46.710854 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:14:46.710820    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:14:46.719407 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:14:46.719384    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:14:46.725540 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:14:46.725513    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:19:46.730101 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:19:46.730072    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:19:46.737767 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:19:46.737745    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:19:46.745332 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:19:46.745310    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:19:46.752108 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:19:46.752091    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:21:18.433774 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.433681    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"]
Jul 30 04:21:18.436888 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.436872    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.440893 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.440866    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5f61e5\"/\"openshift-service-ca.crt\""
Jul 30 04:21:18.441106 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.441081    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5f61e5\"/\"default-dockercfg-z5sn4\""
Jul 30 04:21:18.441225 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.441107    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-5f61e5\"/\"kube-root-ca.crt\""
Jul 30 04:21:18.441225 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.441107    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-5f61e5\"/\"test-model-5f61e5-kserve-self-signed-certs\""
Jul 30 04:21:18.447910 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.447886    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"]
Jul 30 04:21:18.599494 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.599453    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-dshm\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.599705 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.599511    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tls-certs\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.599705 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.599638    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-model-cache\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.599705 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.599669    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8tfl\" (UniqueName: \"kubernetes.io/projected/60312e05-2e1b-464b-b522-a8a8ba7e0dda-kube-api-access-z8tfl\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.599705 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.599691    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tmp-dir\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.599858 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.599756    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-home\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.700832 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.700738    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-model-cache\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.700832 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.700777    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8tfl\" (UniqueName: \"kubernetes.io/projected/60312e05-2e1b-464b-b522-a8a8ba7e0dda-kube-api-access-z8tfl\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.700832 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.700797    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tmp-dir\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.700832 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.700820    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-home\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.701165 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.700845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-dshm\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.701165 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.700881    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tls-certs\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.701294 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.701269    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-home\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.701356 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.701269    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tmp-dir\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.701421 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.701356    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-model-cache\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.703248 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.703222    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-dshm\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.703467 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.703448    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tls-certs\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.710588 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.710562    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8tfl\" (UniqueName: \"kubernetes.io/projected/60312e05-2e1b-464b-b522-a8a8ba7e0dda-kube-api-access-z8tfl\") pod \"test-model-5f61e5-kserve-76d7498497-l2s7w\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") " pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.746394 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.746346    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:18.889129 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.889091    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"]
Jul 30 04:21:18.892880 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:21:18.892847    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60312e05_2e1b_464b_b522_a8a8ba7e0dda.slice/crio-c73682510a347e5f1e86b2645bbb1ec39c9ee1a27b07e8ca0aa693280a88bff8 WatchSource:0}: Error finding container c73682510a347e5f1e86b2645bbb1ec39c9ee1a27b07e8ca0aa693280a88bff8: Status 404 returned error can't find the container with id c73682510a347e5f1e86b2645bbb1ec39c9ee1a27b07e8ca0aa693280a88bff8
Jul 30 04:21:18.894850 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:18.894825    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 04:21:19.809954 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:19.809913    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w" event={"ID":"60312e05-2e1b-464b-b522-a8a8ba7e0dda","Type":"ContainerStarted","Data":"c73682510a347e5f1e86b2645bbb1ec39c9ee1a27b07e8ca0aa693280a88bff8"}
Jul 30 04:21:20.816040 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:20.816004    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w" event={"ID":"60312e05-2e1b-464b-b522-a8a8ba7e0dda","Type":"ContainerStarted","Data":"baff595bec79a17d6bad1299a678bf2ddca06e40a0df28cfc3f17baf495fed19"}
Jul 30 04:21:20.834675 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:20.834625    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w" podStartSLOduration=1.803272188 podStartE2EDuration="2.834607763s" totalImagesPullingTime="1.031335575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 04:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 04:21:20.833517655 +0000 UTC m=+2794.672424943" watchObservedRunningTime="2026-07-30 04:21:20.834607763 +0000 UTC m=+2794.673515049"
Jul 30 04:21:28.746943 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:28.746898    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:28.747476 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:28.746964    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:28.759473 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:28.759437    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:21:28.863218 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:21:28.863188    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:22:15.989857 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:15.989822    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"]
Jul 30 04:22:31.011053 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.010992    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w" podUID="60312e05-2e1b-464b-b522-a8a8ba7e0dda" containerName="main" containerID="cri-o://baff595bec79a17d6bad1299a678bf2ddca06e40a0df28cfc3f17baf495fed19" gracePeriod=45
Jul 30 04:22:31.133424 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.133393    2571 generic.go:356] "Generic (PLEG): container finished" podID="60312e05-2e1b-464b-b522-a8a8ba7e0dda" containerID="baff595bec79a17d6bad1299a678bf2ddca06e40a0df28cfc3f17baf495fed19" exitCode=0
Jul 30 04:22:31.133586 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.133435    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w" event={"ID":"60312e05-2e1b-464b-b522-a8a8ba7e0dda","Type":"ContainerDied","Data":"baff595bec79a17d6bad1299a678bf2ddca06e40a0df28cfc3f17baf495fed19"}
Jul 30 04:22:31.271815 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.271748    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:22:31.334668 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.334634    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-home\") pod \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") "
Jul 30 04:22:31.334828 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.334679    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8tfl\" (UniqueName: \"kubernetes.io/projected/60312e05-2e1b-464b-b522-a8a8ba7e0dda-kube-api-access-z8tfl\") pod \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") "
Jul 30 04:22:31.334828 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.334700    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-dshm\") pod \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") "
Jul 30 04:22:31.334916 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.334842    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tls-certs\") pod \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") "
Jul 30 04:22:31.334916 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.334889    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-model-cache\") pod \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") "
Jul 30 04:22:31.335009 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.334941    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-home" (OuterVolumeSpecName: "home") pod "60312e05-2e1b-464b-b522-a8a8ba7e0dda" (UID: "60312e05-2e1b-464b-b522-a8a8ba7e0dda"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:22:31.335062 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.335011    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tmp-dir\") pod \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\" (UID: \"60312e05-2e1b-464b-b522-a8a8ba7e0dda\") "
Jul 30 04:22:31.335174 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.335102    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-model-cache" (OuterVolumeSpecName: "model-cache") pod "60312e05-2e1b-464b-b522-a8a8ba7e0dda" (UID: "60312e05-2e1b-464b-b522-a8a8ba7e0dda"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:22:31.335285 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.335256    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60312e05-2e1b-464b-b522-a8a8ba7e0dda" (UID: "60312e05-2e1b-464b-b522-a8a8ba7e0dda"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:22:31.335356 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.335336    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-model-cache\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:22:31.335408 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.335362    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tmp-dir\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:22:31.335408 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.335375    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-home\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:22:31.337035 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.337008    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60312e05-2e1b-464b-b522-a8a8ba7e0dda" (UID: "60312e05-2e1b-464b-b522-a8a8ba7e0dda"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 04:22:31.337140 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.337017    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-dshm" (OuterVolumeSpecName: "dshm") pod "60312e05-2e1b-464b-b522-a8a8ba7e0dda" (UID: "60312e05-2e1b-464b-b522-a8a8ba7e0dda"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:22:31.337140 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.337047    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60312e05-2e1b-464b-b522-a8a8ba7e0dda-kube-api-access-z8tfl" (OuterVolumeSpecName: "kube-api-access-z8tfl") pod "60312e05-2e1b-464b-b522-a8a8ba7e0dda" (UID: "60312e05-2e1b-464b-b522-a8a8ba7e0dda"). InnerVolumeSpecName "kube-api-access-z8tfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 04:22:31.435999 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.435959    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8tfl\" (UniqueName: \"kubernetes.io/projected/60312e05-2e1b-464b-b522-a8a8ba7e0dda-kube-api-access-z8tfl\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:22:31.435999 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.435993    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60312e05-2e1b-464b-b522-a8a8ba7e0dda-dshm\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:22:31.435999 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:31.436002    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60312e05-2e1b-464b-b522-a8a8ba7e0dda-tls-certs\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:22:32.138750 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:32.138717    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"
Jul 30 04:22:32.138750 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:32.138746    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w" event={"ID":"60312e05-2e1b-464b-b522-a8a8ba7e0dda","Type":"ContainerDied","Data":"c73682510a347e5f1e86b2645bbb1ec39c9ee1a27b07e8ca0aa693280a88bff8"}
Jul 30 04:22:32.139245 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:32.138795    2571 scope.go:117] "RemoveContainer" containerID="baff595bec79a17d6bad1299a678bf2ddca06e40a0df28cfc3f17baf495fed19"
Jul 30 04:22:32.160135 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:32.160108    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"]
Jul 30 04:22:32.164077 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:32.164056    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-5f61e5/test-model-5f61e5-kserve-76d7498497-l2s7w"]
Jul 30 04:22:32.640999 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:22:32.640964    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60312e05-2e1b-464b-b522-a8a8ba7e0dda" path="/var/lib/kubelet/pods/60312e05-2e1b-464b-b522-a8a8ba7e0dda/volumes"
Jul 30 04:24:46.756346 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:24:46.756230    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:24:46.764006 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:24:46.763981    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:24:46.771848 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:24:46.771830    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:24:46.778307 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:24:46.778291    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:26:04.329896 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.329862    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"]
Jul 30 04:26:04.330320 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.330232    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60312e05-2e1b-464b-b522-a8a8ba7e0dda" containerName="main"
Jul 30 04:26:04.330320 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.330244    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="60312e05-2e1b-464b-b522-a8a8ba7e0dda" containerName="main"
Jul 30 04:26:04.330320 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.330315    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="60312e05-2e1b-464b-b522-a8a8ba7e0dda" containerName="main"
Jul 30 04:26:04.333322 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.333304    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.337283 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.337255    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-19ef02\"/\"openshift-service-ca.crt\""
Jul 30 04:26:04.337454 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.337255    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-19ef02\"/\"default-dockercfg-5wkr8\""
Jul 30 04:26:04.337454 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.337260    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-19ef02\"/\"auth-test-model-19ef02-kserve-self-signed-certs\""
Jul 30 04:26:04.337454 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.337306    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-19ef02\"/\"kube-root-ca.crt\""
Jul 30 04:26:04.341727 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.341696    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"]
Jul 30 04:26:04.464110 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.464070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1829d84-bd3a-432e-b64e-8052553da44e-tls-certs\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.464110 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.464110    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-dshm\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.464339 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.464128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-tmp-dir\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.464339 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.464182    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-home\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.464339 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.464200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-model-cache\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.464339 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.464217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97mwt\" (UniqueName: \"kubernetes.io/projected/a1829d84-bd3a-432e-b64e-8052553da44e-kube-api-access-97mwt\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.565300 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.565271    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-model-cache\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.565502 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.565304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97mwt\" (UniqueName: \"kubernetes.io/projected/a1829d84-bd3a-432e-b64e-8052553da44e-kube-api-access-97mwt\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.565502 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.565350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1829d84-bd3a-432e-b64e-8052553da44e-tls-certs\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.565502 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.565379    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-dshm\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.565502 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.565400    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-tmp-dir\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.565729 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.565577    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-home\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.565799 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.565740    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-model-cache\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.565846 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.565820    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-tmp-dir\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.565894 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.565875    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-home\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.567567 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.567523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-dshm\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.567893 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.567872    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1829d84-bd3a-432e-b64e-8052553da44e-tls-certs\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.573592 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.573569    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97mwt\" (UniqueName: \"kubernetes.io/projected/a1829d84-bd3a-432e-b64e-8052553da44e-kube-api-access-97mwt\") pod \"auth-test-model-19ef02-kserve-7ffdc76755-dkgkj\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") " pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.643360 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.643332    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:04.774617 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:04.774563    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"]
Jul 30 04:26:04.776760 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:26:04.776734    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1829d84_bd3a_432e_b64e_8052553da44e.slice/crio-9fcbaf2dc8fbff21061ed4c7bfe2c18a1253f5113285476b122f766b6c8ebcc1 WatchSource:0}: Error finding container 9fcbaf2dc8fbff21061ed4c7bfe2c18a1253f5113285476b122f766b6c8ebcc1: Status 404 returned error can't find the container with id 9fcbaf2dc8fbff21061ed4c7bfe2c18a1253f5113285476b122f766b6c8ebcc1
Jul 30 04:26:05.111430 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:05.111335    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj" event={"ID":"a1829d84-bd3a-432e-b64e-8052553da44e","Type":"ContainerStarted","Data":"3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b"}
Jul 30 04:26:05.111430 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:05.111385    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj" event={"ID":"a1829d84-bd3a-432e-b64e-8052553da44e","Type":"ContainerStarted","Data":"9fcbaf2dc8fbff21061ed4c7bfe2c18a1253f5113285476b122f766b6c8ebcc1"}
Jul 30 04:26:05.127549 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:05.127472    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj" podStartSLOduration=1.127456366 podStartE2EDuration="1.127456366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 04:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 04:26:05.127230579 +0000 UTC m=+3078.966137867" watchObservedRunningTime="2026-07-30 04:26:05.127456366 +0000 UTC m=+3078.966363651"
Jul 30 04:26:14.643943 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:14.643911    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:14.643943 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:14.643954    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:14.656563 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:14.656541    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:15.165145 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:15.165112    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:26:26.427965 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.427921    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"]
Jul 30 04:26:26.431707 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.431685    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.435422 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.435388    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"kube-root-ca.crt\""
Jul 30 04:26:26.435422 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.435411    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"auth-test-model-fcf3e6-kserve-self-signed-certs\""
Jul 30 04:26:26.435660 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.435393    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"default-dockercfg-mj9bp\""
Jul 30 04:26:26.435660 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.435389    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"openshift-service-ca.crt\""
Jul 30 04:26:26.438706 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.438675    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"]
Jul 30 04:26:26.560223 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.560183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-dshm\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.560223 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.560220    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-model-cache\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.560449 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.560240    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-home\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.560449 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.560258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tls-certs\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.560449 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.560310    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmgz6\" (UniqueName: \"kubernetes.io/projected/27ae9cb9-0a1a-401d-918e-3034573bc4ba-kube-api-access-zmgz6\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.560449 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.560355    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tmp-dir\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.661662 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.661625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-dshm\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.661662 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.661669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-model-cache\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.661931 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.661687    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-home\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.661931 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.661703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tls-certs\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.661931 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.661730    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmgz6\" (UniqueName: \"kubernetes.io/projected/27ae9cb9-0a1a-401d-918e-3034573bc4ba-kube-api-access-zmgz6\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.661931 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.661774    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tmp-dir\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.662146 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.662115    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-home\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.662186 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.662158    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tmp-dir\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.662241 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.662222    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-model-cache\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.663960 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.663938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-dshm\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.664216 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.664199    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tls-certs\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.669769 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.669750    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmgz6\" (UniqueName: \"kubernetes.io/projected/27ae9cb9-0a1a-401d-918e-3034573bc4ba-kube-api-access-zmgz6\") pod \"auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") " pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.742878 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.742786    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:26.882223 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:26.878846    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"]
Jul 30 04:26:27.209555 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:27.209491    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz" event={"ID":"27ae9cb9-0a1a-401d-918e-3034573bc4ba","Type":"ContainerStarted","Data":"b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d"}
Jul 30 04:26:27.209737 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:27.209575    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz" event={"ID":"27ae9cb9-0a1a-401d-918e-3034573bc4ba","Type":"ContainerStarted","Data":"743a963ae8e80fd768c931f1ca37a80ebdbae5c2dbb3edb5752c66e3fa4658c9"}
Jul 30 04:26:27.226773 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:27.226725    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz" podStartSLOduration=1.226711236 podStartE2EDuration="1.226711236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 04:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 04:26:27.224773977 +0000 UTC m=+3101.063681265" watchObservedRunningTime="2026-07-30 04:26:27.226711236 +0000 UTC m=+3101.065618523"
Jul 30 04:26:36.743507 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:36.743462    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:36.743507 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:36.743522    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:36.756279 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:36.756243    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:26:37.266833 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:26:37.266801    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:29:46.783266 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:29:46.783153    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:29:46.790856 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:29:46.790829    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:29:46.799705 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:29:46.799681    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:29:46.805640 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:29:46.805620    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:31:17.259231 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:17.259194    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"]
Jul 30 04:31:18.278615 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:18.278577    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"]
Jul 30 04:31:32.279674 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.279625    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj" podUID="a1829d84-bd3a-432e-b64e-8052553da44e" containerName="main" containerID="cri-o://3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b" gracePeriod=45
Jul 30 04:31:32.534156 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.534086    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:31:32.588089 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.588056    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1829d84-bd3a-432e-b64e-8052553da44e-tls-certs\") pod \"a1829d84-bd3a-432e-b64e-8052553da44e\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") "
Jul 30 04:31:32.588262 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.588105    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-home\") pod \"a1829d84-bd3a-432e-b64e-8052553da44e\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") "
Jul 30 04:31:32.588262 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.588137    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97mwt\" (UniqueName: \"kubernetes.io/projected/a1829d84-bd3a-432e-b64e-8052553da44e-kube-api-access-97mwt\") pod \"a1829d84-bd3a-432e-b64e-8052553da44e\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") "
Jul 30 04:31:32.588262 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.588194    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-dshm\") pod \"a1829d84-bd3a-432e-b64e-8052553da44e\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") "
Jul 30 04:31:32.588262 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.588222    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-tmp-dir\") pod \"a1829d84-bd3a-432e-b64e-8052553da44e\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") "
Jul 30 04:31:32.588262 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.588245    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-model-cache\") pod \"a1829d84-bd3a-432e-b64e-8052553da44e\" (UID: \"a1829d84-bd3a-432e-b64e-8052553da44e\") "
Jul 30 04:31:32.588493 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.588422    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-home" (OuterVolumeSpecName: "home") pod "a1829d84-bd3a-432e-b64e-8052553da44e" (UID: "a1829d84-bd3a-432e-b64e-8052553da44e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:31:32.588575 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.588508    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-home\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:32.588686 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.588663    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a1829d84-bd3a-432e-b64e-8052553da44e" (UID: "a1829d84-bd3a-432e-b64e-8052553da44e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:31:32.588751 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.588700    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-model-cache" (OuterVolumeSpecName: "model-cache") pod "a1829d84-bd3a-432e-b64e-8052553da44e" (UID: "a1829d84-bd3a-432e-b64e-8052553da44e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:31:32.590576 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.590517    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1829d84-bd3a-432e-b64e-8052553da44e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a1829d84-bd3a-432e-b64e-8052553da44e" (UID: "a1829d84-bd3a-432e-b64e-8052553da44e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 04:31:32.590690 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.590577    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-dshm" (OuterVolumeSpecName: "dshm") pod "a1829d84-bd3a-432e-b64e-8052553da44e" (UID: "a1829d84-bd3a-432e-b64e-8052553da44e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:31:32.590690 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.590602    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1829d84-bd3a-432e-b64e-8052553da44e-kube-api-access-97mwt" (OuterVolumeSpecName: "kube-api-access-97mwt") pod "a1829d84-bd3a-432e-b64e-8052553da44e" (UID: "a1829d84-bd3a-432e-b64e-8052553da44e"). InnerVolumeSpecName "kube-api-access-97mwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 04:31:32.628585 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.628515    2571 generic.go:356] "Generic (PLEG): container finished" podID="a1829d84-bd3a-432e-b64e-8052553da44e" containerID="3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b" exitCode=0
Jul 30 04:31:32.628585 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.628585    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"
Jul 30 04:31:32.628788 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.628600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj" event={"ID":"a1829d84-bd3a-432e-b64e-8052553da44e","Type":"ContainerDied","Data":"3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b"}
Jul 30 04:31:32.628788 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.628661    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj" event={"ID":"a1829d84-bd3a-432e-b64e-8052553da44e","Type":"ContainerDied","Data":"9fcbaf2dc8fbff21061ed4c7bfe2c18a1253f5113285476b122f766b6c8ebcc1"}
Jul 30 04:31:32.628788 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.628679    2571 scope.go:117] "RemoveContainer" containerID="3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b"
Jul 30 04:31:32.638051 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.638032    2571 scope.go:117] "RemoveContainer" containerID="3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b"
Jul 30 04:31:32.638326 ip-10-0-136-241 kubenswrapper[2571]: E0730 04:31:32.638305    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b\": container with ID starting with 3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b not found: ID does not exist" containerID="3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b"
Jul 30 04:31:32.638400 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.638341    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b"} err="failed to get container status \"3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b\": rpc error: code = NotFound desc = could not find container \"3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b\": container with ID starting with 3bc78cf99259dcd46ea58401a48a3181f03d25e1d3b8f0d9d511857cbdad568b not found: ID does not exist"
Jul 30 04:31:32.650632 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.650592    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"]
Jul 30 04:31:32.654334 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.654302    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/auth-test-model-19ef02-kserve-7ffdc76755-dkgkj"]
Jul 30 04:31:32.688888 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.688853    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97mwt\" (UniqueName: \"kubernetes.io/projected/a1829d84-bd3a-432e-b64e-8052553da44e-kube-api-access-97mwt\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:32.688888 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.688882    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-dshm\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:32.688888 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.688893    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-tmp-dir\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:32.689174 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.688903    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1829d84-bd3a-432e-b64e-8052553da44e-model-cache\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:32.689174 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:32.688911    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1829d84-bd3a-432e-b64e-8052553da44e-tls-certs\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:33.298143 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.298081    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz" podUID="27ae9cb9-0a1a-401d-918e-3034573bc4ba" containerName="main" containerID="cri-o://b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d" gracePeriod=45
Jul 30 04:31:33.555503 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.555440    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:31:33.597192 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.597151    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tmp-dir\") pod \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") "
Jul 30 04:31:33.597391 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.597208    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-dshm\") pod \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") "
Jul 30 04:31:33.597391 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.597249    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-model-cache\") pod \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") "
Jul 30 04:31:33.597391 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.597268    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tls-certs\") pod \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") "
Jul 30 04:31:33.597391 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.597288    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmgz6\" (UniqueName: \"kubernetes.io/projected/27ae9cb9-0a1a-401d-918e-3034573bc4ba-kube-api-access-zmgz6\") pod \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") "
Jul 30 04:31:33.597391 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.597310    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-home\") pod \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\" (UID: \"27ae9cb9-0a1a-401d-918e-3034573bc4ba\") "
Jul 30 04:31:33.597692 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.597516    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "27ae9cb9-0a1a-401d-918e-3034573bc4ba" (UID: "27ae9cb9-0a1a-401d-918e-3034573bc4ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:31:33.597692 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.597581    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-model-cache" (OuterVolumeSpecName: "model-cache") pod "27ae9cb9-0a1a-401d-918e-3034573bc4ba" (UID: "27ae9cb9-0a1a-401d-918e-3034573bc4ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:31:33.597692 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.597658    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tmp-dir\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:33.597800 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.597738    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-home" (OuterVolumeSpecName: "home") pod "27ae9cb9-0a1a-401d-918e-3034573bc4ba" (UID: "27ae9cb9-0a1a-401d-918e-3034573bc4ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:31:33.599860 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.599830    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-dshm" (OuterVolumeSpecName: "dshm") pod "27ae9cb9-0a1a-401d-918e-3034573bc4ba" (UID: "27ae9cb9-0a1a-401d-918e-3034573bc4ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:31:33.599985 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.599899    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "27ae9cb9-0a1a-401d-918e-3034573bc4ba" (UID: "27ae9cb9-0a1a-401d-918e-3034573bc4ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 04:31:33.599985 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.599921    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ae9cb9-0a1a-401d-918e-3034573bc4ba-kube-api-access-zmgz6" (OuterVolumeSpecName: "kube-api-access-zmgz6") pod "27ae9cb9-0a1a-401d-918e-3034573bc4ba" (UID: "27ae9cb9-0a1a-401d-918e-3034573bc4ba"). InnerVolumeSpecName "kube-api-access-zmgz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 04:31:33.642123 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.642088    2571 generic.go:356] "Generic (PLEG): container finished" podID="27ae9cb9-0a1a-401d-918e-3034573bc4ba" containerID="b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d" exitCode=0
Jul 30 04:31:33.642123 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.642124    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz" event={"ID":"27ae9cb9-0a1a-401d-918e-3034573bc4ba","Type":"ContainerDied","Data":"b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d"}
Jul 30 04:31:33.642384 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.642149    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz" event={"ID":"27ae9cb9-0a1a-401d-918e-3034573bc4ba","Type":"ContainerDied","Data":"743a963ae8e80fd768c931f1ca37a80ebdbae5c2dbb3edb5752c66e3fa4658c9"}
Jul 30 04:31:33.642384 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.642153    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"
Jul 30 04:31:33.642384 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.642165    2571 scope.go:117] "RemoveContainer" containerID="b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d"
Jul 30 04:31:33.651062 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.651042    2571 scope.go:117] "RemoveContainer" containerID="b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d"
Jul 30 04:31:33.651350 ip-10-0-136-241 kubenswrapper[2571]: E0730 04:31:33.651330    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d\": container with ID starting with b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d not found: ID does not exist" containerID="b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d"
Jul 30 04:31:33.651395 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.651360    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d"} err="failed to get container status \"b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d\": rpc error: code = NotFound desc = could not find container \"b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d\": container with ID starting with b8e9d38b00ca33d56adebd6bb4651dab5ac0b0310e07ffdf82eaaf8b1e644e9d not found: ID does not exist"
Jul 30 04:31:33.663331 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.663294    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"]
Jul 30 04:31:33.667200 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.667169    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/auth-test-model-fcf3e6-kserve-54c5fb9f5-xkjcz"]
Jul 30 04:31:33.698865 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.698835    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-dshm\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:33.698865 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.698865    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-model-cache\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:33.699056 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.698904    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ae9cb9-0a1a-401d-918e-3034573bc4ba-tls-certs\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:33.699056 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.698917    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmgz6\" (UniqueName: \"kubernetes.io/projected/27ae9cb9-0a1a-401d-918e-3034573bc4ba-kube-api-access-zmgz6\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:33.699056 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:33.698930    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27ae9cb9-0a1a-401d-918e-3034573bc4ba-home\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:31:34.641012 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:34.640972    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27ae9cb9-0a1a-401d-918e-3034573bc4ba" path="/var/lib/kubelet/pods/27ae9cb9-0a1a-401d-918e-3034573bc4ba/volumes"
Jul 30 04:31:34.641419 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:34.641372    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1829d84-bd3a-432e-b64e-8052553da44e" path="/var/lib/kubelet/pods/a1829d84-bd3a-432e-b64e-8052553da44e/volumes"
Jul 30 04:31:52.610689 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.610652    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"]
Jul 30 04:31:52.611204 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.611095    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ae9cb9-0a1a-401d-918e-3034573bc4ba" containerName="main"
Jul 30 04:31:52.611204 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.611114    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ae9cb9-0a1a-401d-918e-3034573bc4ba" containerName="main"
Jul 30 04:31:52.611204 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.611140    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1829d84-bd3a-432e-b64e-8052553da44e" containerName="main"
Jul 30 04:31:52.611204 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.611150    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1829d84-bd3a-432e-b64e-8052553da44e" containerName="main"
Jul 30 04:31:52.611332 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.611265    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ae9cb9-0a1a-401d-918e-3034573bc4ba" containerName="main"
Jul 30 04:31:52.611332 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.611279    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1829d84-bd3a-432e-b64e-8052553da44e" containerName="main"
Jul 30 04:31:52.615700 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.615682    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.618382 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.618358    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"openshift-service-ca.crt\""
Jul 30 04:31:52.619348 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.619329    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"kube-root-ca.crt\""
Jul 30 04:31:52.619458 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.619371    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"default-dockercfg-mj9bp\""
Jul 30 04:31:52.619458 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.619446    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"sub-test-model-fcf3e6-kserve-self-signed-certs\""
Jul 30 04:31:52.623727 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.623709    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"]
Jul 30 04:31:52.660956 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.660914    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-tmp-dir\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.660956 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.660960    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfqxq\" (UniqueName: \"kubernetes.io/projected/4fca1f63-e270-493f-9726-b4f89707b6c9-kube-api-access-mfqxq\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.661171 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.660983    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-home\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.661171 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.661031    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-dshm\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.661171 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.661121    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fca1f63-e270-493f-9726-b4f89707b6c9-tls-certs\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.661171 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.661167    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-model-cache\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.762019 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.761976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-tmp-dir\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.762019 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.762028    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfqxq\" (UniqueName: \"kubernetes.io/projected/4fca1f63-e270-493f-9726-b4f89707b6c9-kube-api-access-mfqxq\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.762298 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.762157    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-home\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.762298 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.762200    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-dshm\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.762298 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.762254    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fca1f63-e270-493f-9726-b4f89707b6c9-tls-certs\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.762447 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.762332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-model-cache\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.762501 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.762446    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-tmp-dir\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.762616 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.762593    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-home\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.763017 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.762998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-model-cache\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.764866 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.764839    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-dshm\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.765003 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.764986    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fca1f63-e270-493f-9726-b4f89707b6c9-tls-certs\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.770815 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.770795    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfqxq\" (UniqueName: \"kubernetes.io/projected/4fca1f63-e270-493f-9726-b4f89707b6c9-kube-api-access-mfqxq\") pod \"sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") " pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:52.925747 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:52.925700    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:31:53.059462 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:53.059430    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"]
Jul 30 04:31:53.061313 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:31:53.061285    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fca1f63_e270_493f_9726_b4f89707b6c9.slice/crio-e5cff5dabaafeb0d6a619afedba3dd8da907756181450c87a8331b0a71ca4188 WatchSource:0}: Error finding container e5cff5dabaafeb0d6a619afedba3dd8da907756181450c87a8331b0a71ca4188: Status 404 returned error can't find the container with id e5cff5dabaafeb0d6a619afedba3dd8da907756181450c87a8331b0a71ca4188
Jul 30 04:31:53.735515 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:53.735475    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4" event={"ID":"4fca1f63-e270-493f-9726-b4f89707b6c9","Type":"ContainerStarted","Data":"9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940"}
Jul 30 04:31:53.735955 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:53.735552    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4" event={"ID":"4fca1f63-e270-493f-9726-b4f89707b6c9","Type":"ContainerStarted","Data":"e5cff5dabaafeb0d6a619afedba3dd8da907756181450c87a8331b0a71ca4188"}
Jul 30 04:31:53.753940 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:31:53.753884    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4" podStartSLOduration=1.75386948 podStartE2EDuration="1.75386948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 04:31:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 04:31:53.752560292 +0000 UTC m=+3427.591467580" watchObservedRunningTime="2026-07-30 04:31:53.75386948 +0000 UTC m=+3427.592776793"
Jul 30 04:32:02.926795 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:32:02.926753    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:32:02.926795 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:32:02.926806    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:32:02.939396 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:32:02.939364    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:32:03.795659 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:32:03.795628    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:33:39.401342 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:39.401302    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"]
Jul 30 04:33:54.421129 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.421076    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4" podUID="4fca1f63-e270-493f-9726-b4f89707b6c9" containerName="main" containerID="cri-o://9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940" gracePeriod=45
Jul 30 04:33:54.689936 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.689908    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:33:54.812248 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.812206    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fca1f63-e270-493f-9726-b4f89707b6c9-tls-certs\") pod \"4fca1f63-e270-493f-9726-b4f89707b6c9\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") "
Jul 30 04:33:54.812248 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.812247    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-home\") pod \"4fca1f63-e270-493f-9726-b4f89707b6c9\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") "
Jul 30 04:33:54.812490 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.812268    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfqxq\" (UniqueName: \"kubernetes.io/projected/4fca1f63-e270-493f-9726-b4f89707b6c9-kube-api-access-mfqxq\") pod \"4fca1f63-e270-493f-9726-b4f89707b6c9\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") "
Jul 30 04:33:54.812490 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.812309    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-dshm\") pod \"4fca1f63-e270-493f-9726-b4f89707b6c9\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") "
Jul 30 04:33:54.812490 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.812352    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-tmp-dir\") pod \"4fca1f63-e270-493f-9726-b4f89707b6c9\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") "
Jul 30 04:33:54.812490 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.812374    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-model-cache\") pod \"4fca1f63-e270-493f-9726-b4f89707b6c9\" (UID: \"4fca1f63-e270-493f-9726-b4f89707b6c9\") "
Jul 30 04:33:54.812720 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.812575    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-home" (OuterVolumeSpecName: "home") pod "4fca1f63-e270-493f-9726-b4f89707b6c9" (UID: "4fca1f63-e270-493f-9726-b4f89707b6c9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:33:54.812720 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.812656    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4fca1f63-e270-493f-9726-b4f89707b6c9" (UID: "4fca1f63-e270-493f-9726-b4f89707b6c9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:33:54.812720 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.812688    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-home\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:33:54.812882 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.812702    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-model-cache" (OuterVolumeSpecName: "model-cache") pod "4fca1f63-e270-493f-9726-b4f89707b6c9" (UID: "4fca1f63-e270-493f-9726-b4f89707b6c9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:33:54.814390 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.814368    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-dshm" (OuterVolumeSpecName: "dshm") pod "4fca1f63-e270-493f-9726-b4f89707b6c9" (UID: "4fca1f63-e270-493f-9726-b4f89707b6c9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:33:54.814513 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.814404    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fca1f63-e270-493f-9726-b4f89707b6c9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4fca1f63-e270-493f-9726-b4f89707b6c9" (UID: "4fca1f63-e270-493f-9726-b4f89707b6c9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 04:33:54.814513 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.814451    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fca1f63-e270-493f-9726-b4f89707b6c9-kube-api-access-mfqxq" (OuterVolumeSpecName: "kube-api-access-mfqxq") pod "4fca1f63-e270-493f-9726-b4f89707b6c9" (UID: "4fca1f63-e270-493f-9726-b4f89707b6c9"). InnerVolumeSpecName "kube-api-access-mfqxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 04:33:54.914084 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.914044    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fca1f63-e270-493f-9726-b4f89707b6c9-tls-certs\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:33:54.914084 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.914075    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfqxq\" (UniqueName: \"kubernetes.io/projected/4fca1f63-e270-493f-9726-b4f89707b6c9-kube-api-access-mfqxq\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:33:54.914084 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.914087    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-dshm\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:33:54.914084 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.914096    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-tmp-dir\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:33:54.914357 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:54.914105    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fca1f63-e270-493f-9726-b4f89707b6c9-model-cache\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:33:55.304087 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:55.304050    2571 generic.go:356] "Generic (PLEG): container finished" podID="4fca1f63-e270-493f-9726-b4f89707b6c9" containerID="9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940" exitCode=0
Jul 30 04:33:55.304287 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:55.304096    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"
Jul 30 04:33:55.304287 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:55.304140    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4" event={"ID":"4fca1f63-e270-493f-9726-b4f89707b6c9","Type":"ContainerDied","Data":"9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940"}
Jul 30 04:33:55.304287 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:55.304184    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4" event={"ID":"4fca1f63-e270-493f-9726-b4f89707b6c9","Type":"ContainerDied","Data":"e5cff5dabaafeb0d6a619afedba3dd8da907756181450c87a8331b0a71ca4188"}
Jul 30 04:33:55.304287 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:55.304203    2571 scope.go:117] "RemoveContainer" containerID="9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940"
Jul 30 04:33:55.312948 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:55.312930    2571 scope.go:117] "RemoveContainer" containerID="9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940"
Jul 30 04:33:55.313212 ip-10-0-136-241 kubenswrapper[2571]: E0730 04:33:55.313192    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940\": container with ID starting with 9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940 not found: ID does not exist" containerID="9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940"
Jul 30 04:33:55.313272 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:55.313218    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940"} err="failed to get container status \"9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940\": rpc error: code = NotFound desc = could not find container \"9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940\": container with ID starting with 9f1921c9bb77030ce4127633fb5b9dc1c91eabaf89d21870f819ce3f078f9940 not found: ID does not exist"
Jul 30 04:33:55.325353 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:55.325329    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"]
Jul 30 04:33:55.326892 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:55.326875    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/sub-test-model-fcf3e6-kserve-79b9745d5-ddqx4"]
Jul 30 04:33:56.641812 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:56.641775    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fca1f63-e270-493f-9726-b4f89707b6c9" path="/var/lib/kubelet/pods/4fca1f63-e270-493f-9726-b4f89707b6c9/volumes"
Jul 30 04:33:59.337993 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.337958    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"]
Jul 30 04:33:59.338431 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.338298    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fca1f63-e270-493f-9726-b4f89707b6c9" containerName="main"
Jul 30 04:33:59.338431 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.338308    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fca1f63-e270-493f-9726-b4f89707b6c9" containerName="main"
Jul 30 04:33:59.338431 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.338372    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fca1f63-e270-493f-9726-b4f89707b6c9" containerName="main"
Jul 30 04:33:59.342886 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.342868    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.346982 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.346956    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-19ef02\"/\"openshift-service-ca.crt\""
Jul 30 04:33:59.347134 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.346997    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-19ef02\"/\"default-dockercfg-5wkr8\""
Jul 30 04:33:59.347134 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.346970    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-19ef02\"/\"kube-root-ca.crt\""
Jul 30 04:33:59.347134 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.346962    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-19ef02\"/\"rate-test-model-19ef02-kserve-self-signed-certs\""
Jul 30 04:33:59.351992 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.351967    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"]
Jul 30 04:33:59.449351 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.449311    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8fa63b5-6191-4924-8360-0bd56a9015f9-tls-certs\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.449581 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.449386    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28h86\" (UniqueName: \"kubernetes.io/projected/a8fa63b5-6191-4924-8360-0bd56a9015f9-kube-api-access-28h86\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.449581 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.449412    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-home\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.449581 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.449446    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-dshm\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.449581 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.449561    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-model-cache\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.449724 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.449600    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-tmp-dir\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.550353 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.550313    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-dshm\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.550596 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.550374    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-model-cache\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.550596 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.550390    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-tmp-dir\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.550596 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.550414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8fa63b5-6191-4924-8360-0bd56a9015f9-tls-certs\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.550596 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.550461    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28h86\" (UniqueName: \"kubernetes.io/projected/a8fa63b5-6191-4924-8360-0bd56a9015f9-kube-api-access-28h86\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.550596 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.550489    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-home\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.550946 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.550919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-model-cache\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.551065 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.550969    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-tmp-dir\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.551065 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.550979    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-home\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.552860 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.552833    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-dshm\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.553154 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.553136    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8fa63b5-6191-4924-8360-0bd56a9015f9-tls-certs\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.559145 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.559123    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28h86\" (UniqueName: \"kubernetes.io/projected/a8fa63b5-6191-4924-8360-0bd56a9015f9-kube-api-access-28h86\") pod \"rate-test-model-19ef02-kserve-7968fff447-ddfhf\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") " pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.653629 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.653593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:33:59.787474 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:33:59.787431    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"]
Jul 30 04:33:59.790851 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:33:59.790816    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8fa63b5_6191_4924_8360_0bd56a9015f9.slice/crio-b4b88ab1dbbd8de354adeb867b534504813abeda27f7ffbd7f74e2413279bab2 WatchSource:0}: Error finding container b4b88ab1dbbd8de354adeb867b534504813abeda27f7ffbd7f74e2413279bab2: Status 404 returned error can't find the container with id b4b88ab1dbbd8de354adeb867b534504813abeda27f7ffbd7f74e2413279bab2
Jul 30 04:34:00.337724 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:00.337683    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf" event={"ID":"a8fa63b5-6191-4924-8360-0bd56a9015f9","Type":"ContainerStarted","Data":"ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63"}
Jul 30 04:34:00.337724 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:00.337732    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf" event={"ID":"a8fa63b5-6191-4924-8360-0bd56a9015f9","Type":"ContainerStarted","Data":"b4b88ab1dbbd8de354adeb867b534504813abeda27f7ffbd7f74e2413279bab2"}
Jul 30 04:34:00.355662 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:00.355606    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf" podStartSLOduration=1.355590739 podStartE2EDuration="1.355590739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 04:33:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 04:34:00.354014308 +0000 UTC m=+3554.192921598" watchObservedRunningTime="2026-07-30 04:34:00.355590739 +0000 UTC m=+3554.194498025"
Jul 30 04:34:09.653820 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:09.653782    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:34:09.654274 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:09.653836    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:34:09.666912 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:09.666875    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:34:10.394661 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:10.394624    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:34:21.025819 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.025786    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"]
Jul 30 04:34:21.029227 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.029203    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.033035 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.033006    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"default-dockercfg-mj9bp\""
Jul 30 04:34:21.033035 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.033022    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"rate-test-model-fcf3e6-kserve-self-signed-certs\""
Jul 30 04:34:21.033261 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.033027    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"openshift-service-ca.crt\""
Jul 30 04:34:21.033261 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.033136    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fcf3e6\"/\"kube-root-ca.crt\""
Jul 30 04:34:21.038838 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.038809    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"]
Jul 30 04:34:21.143242 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.143195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-tmp-dir\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.143424 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.143251    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/916c9a6f-5c94-4198-951d-23d012be66b4-tls-certs\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.143424 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.143275    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g92x\" (UniqueName: \"kubernetes.io/projected/916c9a6f-5c94-4198-951d-23d012be66b4-kube-api-access-6g92x\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.143424 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.143348    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-home\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.143424 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.143392    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-dshm\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.143617 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.143433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-model-cache\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.244733 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.244685    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-tmp-dir\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.244936 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.244745    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/916c9a6f-5c94-4198-951d-23d012be66b4-tls-certs\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.244936 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.244771    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g92x\" (UniqueName: \"kubernetes.io/projected/916c9a6f-5c94-4198-951d-23d012be66b4-kube-api-access-6g92x\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.244936 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.244800    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-home\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.244936 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.244827    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-dshm\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.244936 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.244861    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-model-cache\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.245231 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.245205    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-home\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.245294 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.245200    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-tmp-dir\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.245294 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.245265    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-model-cache\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.247207 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.247186    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-dshm\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.247566 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.247542    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/916c9a6f-5c94-4198-951d-23d012be66b4-tls-certs\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.252666 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.252643    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g92x\" (UniqueName: \"kubernetes.io/projected/916c9a6f-5c94-4198-951d-23d012be66b4-kube-api-access-6g92x\") pod \"rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") " pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.340853 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.340761    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:21.476193 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:21.476142    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"]
Jul 30 04:34:21.478609 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:34:21.478576    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod916c9a6f_5c94_4198_951d_23d012be66b4.slice/crio-15aacd4f5c6ad324caa8b0d5e02de6df9ef5f099ae7d0cb52758460fb117b049 WatchSource:0}: Error finding container 15aacd4f5c6ad324caa8b0d5e02de6df9ef5f099ae7d0cb52758460fb117b049: Status 404 returned error can't find the container with id 15aacd4f5c6ad324caa8b0d5e02de6df9ef5f099ae7d0cb52758460fb117b049
Jul 30 04:34:22.439511 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:22.439475    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz" event={"ID":"916c9a6f-5c94-4198-951d-23d012be66b4","Type":"ContainerStarted","Data":"0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e"}
Jul 30 04:34:22.439511 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:22.439516    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz" event={"ID":"916c9a6f-5c94-4198-951d-23d012be66b4","Type":"ContainerStarted","Data":"15aacd4f5c6ad324caa8b0d5e02de6df9ef5f099ae7d0cb52758460fb117b049"}
Jul 30 04:34:22.457680 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:22.457623    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz" podStartSLOduration=1.45760669 podStartE2EDuration="1.45760669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 04:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 04:34:22.455424947 +0000 UTC m=+3576.294332235" watchObservedRunningTime="2026-07-30 04:34:22.45760669 +0000 UTC m=+3576.296513977"
Jul 30 04:34:31.341512 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:31.341462    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:31.342154 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:31.341556    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:31.354104 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:31.354075    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:31.492835 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:31.492802    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:34:46.810377 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:46.810263    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:34:46.818041 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:46.817539    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:34:46.826929 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:46.826902    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:34:46.833869 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:34:46.833845    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:36:10.508480 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:10.508396    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"]
Jul 30 04:36:11.435446 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:11.435410    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"]
Jul 30 04:36:25.527576 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.527515    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf" podUID="a8fa63b5-6191-4924-8360-0bd56a9015f9" containerName="main" containerID="cri-o://ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63" gracePeriod=45
Jul 30 04:36:25.778726 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.778657    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:36:25.844449 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.844415    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-home\") pod \"a8fa63b5-6191-4924-8360-0bd56a9015f9\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") "
Jul 30 04:36:25.844644 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.844479    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-tmp-dir\") pod \"a8fa63b5-6191-4924-8360-0bd56a9015f9\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") "
Jul 30 04:36:25.844644 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.844541    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28h86\" (UniqueName: \"kubernetes.io/projected/a8fa63b5-6191-4924-8360-0bd56a9015f9-kube-api-access-28h86\") pod \"a8fa63b5-6191-4924-8360-0bd56a9015f9\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") "
Jul 30 04:36:25.844644 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.844581    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8fa63b5-6191-4924-8360-0bd56a9015f9-tls-certs\") pod \"a8fa63b5-6191-4924-8360-0bd56a9015f9\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") "
Jul 30 04:36:25.844644 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.844625    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-model-cache\") pod \"a8fa63b5-6191-4924-8360-0bd56a9015f9\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") "
Jul 30 04:36:25.844826 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.844675    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-dshm\") pod \"a8fa63b5-6191-4924-8360-0bd56a9015f9\" (UID: \"a8fa63b5-6191-4924-8360-0bd56a9015f9\") "
Jul 30 04:36:25.844826 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.844768    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8fa63b5-6191-4924-8360-0bd56a9015f9" (UID: "a8fa63b5-6191-4924-8360-0bd56a9015f9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:36:25.844826 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.844792    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-home" (OuterVolumeSpecName: "home") pod "a8fa63b5-6191-4924-8360-0bd56a9015f9" (UID: "a8fa63b5-6191-4924-8360-0bd56a9015f9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:36:25.844987 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.844927    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8fa63b5-6191-4924-8360-0bd56a9015f9" (UID: "a8fa63b5-6191-4924-8360-0bd56a9015f9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:36:25.845063 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.845046    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-tmp-dir\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:25.845106 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.845064    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-model-cache\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:25.845106 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.845073    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-home\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:25.846735 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.846707    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-dshm" (OuterVolumeSpecName: "dshm") pod "a8fa63b5-6191-4924-8360-0bd56a9015f9" (UID: "a8fa63b5-6191-4924-8360-0bd56a9015f9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:36:25.846860 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.846788    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8fa63b5-6191-4924-8360-0bd56a9015f9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8fa63b5-6191-4924-8360-0bd56a9015f9" (UID: "a8fa63b5-6191-4924-8360-0bd56a9015f9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 04:36:25.846860 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.846804    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8fa63b5-6191-4924-8360-0bd56a9015f9-kube-api-access-28h86" (OuterVolumeSpecName: "kube-api-access-28h86") pod "a8fa63b5-6191-4924-8360-0bd56a9015f9" (UID: "a8fa63b5-6191-4924-8360-0bd56a9015f9"). InnerVolumeSpecName "kube-api-access-28h86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 04:36:25.945673 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.945635    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8fa63b5-6191-4924-8360-0bd56a9015f9-tls-certs\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:25.945673 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.945671    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8fa63b5-6191-4924-8360-0bd56a9015f9-dshm\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:25.945879 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:25.945685    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28h86\" (UniqueName: \"kubernetes.io/projected/a8fa63b5-6191-4924-8360-0bd56a9015f9-kube-api-access-28h86\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:26.007831 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.007789    2571 generic.go:356] "Generic (PLEG): container finished" podID="a8fa63b5-6191-4924-8360-0bd56a9015f9" containerID="ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63" exitCode=0
Jul 30 04:36:26.008038 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.007837    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"
Jul 30 04:36:26.008038 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.007879    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf" event={"ID":"a8fa63b5-6191-4924-8360-0bd56a9015f9","Type":"ContainerDied","Data":"ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63"}
Jul 30 04:36:26.008038 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.007924    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf" event={"ID":"a8fa63b5-6191-4924-8360-0bd56a9015f9","Type":"ContainerDied","Data":"b4b88ab1dbbd8de354adeb867b534504813abeda27f7ffbd7f74e2413279bab2"}
Jul 30 04:36:26.008038 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.007943    2571 scope.go:117] "RemoveContainer" containerID="ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63"
Jul 30 04:36:26.017980 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.017957    2571 scope.go:117] "RemoveContainer" containerID="ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63"
Jul 30 04:36:26.018247 ip-10-0-136-241 kubenswrapper[2571]: E0730 04:36:26.018228    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63\": container with ID starting with ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63 not found: ID does not exist" containerID="ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63"
Jul 30 04:36:26.018310 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.018259    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63"} err="failed to get container status \"ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63\": rpc error: code = NotFound desc = could not find container \"ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63\": container with ID starting with ac37039e2cc23d12b3035bc5944a3252a66745dbbd0c41c6df2e0992e8cece63 not found: ID does not exist"
Jul 30 04:36:26.036123 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.035496    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"]
Jul 30 04:36:26.036123 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.035568    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-19ef02/rate-test-model-19ef02-kserve-7968fff447-ddfhf"]
Jul 30 04:36:26.454781 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.454736    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz" podUID="916c9a6f-5c94-4198-951d-23d012be66b4" containerName="main" containerID="cri-o://0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e" gracePeriod=45
Jul 30 04:36:26.643228 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.643191    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8fa63b5-6191-4924-8360-0bd56a9015f9" path="/var/lib/kubelet/pods/a8fa63b5-6191-4924-8360-0bd56a9015f9/volumes"
Jul 30 04:36:26.700789 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.700763    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:36:26.752704 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.752615    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-home\") pod \"916c9a6f-5c94-4198-951d-23d012be66b4\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") "
Jul 30 04:36:26.752704 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.752667    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/916c9a6f-5c94-4198-951d-23d012be66b4-tls-certs\") pod \"916c9a6f-5c94-4198-951d-23d012be66b4\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") "
Jul 30 04:36:26.752924 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.752710    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-tmp-dir\") pod \"916c9a6f-5c94-4198-951d-23d012be66b4\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") "
Jul 30 04:36:26.752924 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.752729    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-dshm\") pod \"916c9a6f-5c94-4198-951d-23d012be66b4\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") "
Jul 30 04:36:26.752924 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.752753    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g92x\" (UniqueName: \"kubernetes.io/projected/916c9a6f-5c94-4198-951d-23d012be66b4-kube-api-access-6g92x\") pod \"916c9a6f-5c94-4198-951d-23d012be66b4\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") "
Jul 30 04:36:26.752924 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.752774    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-model-cache\") pod \"916c9a6f-5c94-4198-951d-23d012be66b4\" (UID: \"916c9a6f-5c94-4198-951d-23d012be66b4\") "
Jul 30 04:36:26.753131 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.752943    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "916c9a6f-5c94-4198-951d-23d012be66b4" (UID: "916c9a6f-5c94-4198-951d-23d012be66b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:36:26.753131 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.752953    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-home" (OuterVolumeSpecName: "home") pod "916c9a6f-5c94-4198-951d-23d012be66b4" (UID: "916c9a6f-5c94-4198-951d-23d012be66b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:36:26.753236 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.753135    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-tmp-dir\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:26.753236 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.753165    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-home\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:26.753236 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.753163    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "916c9a6f-5c94-4198-951d-23d012be66b4" (UID: "916c9a6f-5c94-4198-951d-23d012be66b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:36:26.754932 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.754899    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/916c9a6f-5c94-4198-951d-23d012be66b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "916c9a6f-5c94-4198-951d-23d012be66b4" (UID: "916c9a6f-5c94-4198-951d-23d012be66b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 04:36:26.754932 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.754914    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-dshm" (OuterVolumeSpecName: "dshm") pod "916c9a6f-5c94-4198-951d-23d012be66b4" (UID: "916c9a6f-5c94-4198-951d-23d012be66b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:36:26.754932 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.754919    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/916c9a6f-5c94-4198-951d-23d012be66b4-kube-api-access-6g92x" (OuterVolumeSpecName: "kube-api-access-6g92x") pod "916c9a6f-5c94-4198-951d-23d012be66b4" (UID: "916c9a6f-5c94-4198-951d-23d012be66b4"). InnerVolumeSpecName "kube-api-access-6g92x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 04:36:26.854595 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.854557    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-dshm\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:26.854595 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.854588    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g92x\" (UniqueName: \"kubernetes.io/projected/916c9a6f-5c94-4198-951d-23d012be66b4-kube-api-access-6g92x\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:26.854595 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.854599    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/916c9a6f-5c94-4198-951d-23d012be66b4-model-cache\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:26.854595 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:26.854608    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/916c9a6f-5c94-4198-951d-23d012be66b4-tls-certs\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:27.013501 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.013408    2571 generic.go:356] "Generic (PLEG): container finished" podID="916c9a6f-5c94-4198-951d-23d012be66b4" containerID="0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e" exitCode=0
Jul 30 04:36:27.013501 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.013455    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"
Jul 30 04:36:27.013501 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.013490    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz" event={"ID":"916c9a6f-5c94-4198-951d-23d012be66b4","Type":"ContainerDied","Data":"0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e"}
Jul 30 04:36:27.013783 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.013553    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz" event={"ID":"916c9a6f-5c94-4198-951d-23d012be66b4","Type":"ContainerDied","Data":"15aacd4f5c6ad324caa8b0d5e02de6df9ef5f099ae7d0cb52758460fb117b049"}
Jul 30 04:36:27.013783 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.013580    2571 scope.go:117] "RemoveContainer" containerID="0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e"
Jul 30 04:36:27.022427 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.022412    2571 scope.go:117] "RemoveContainer" containerID="0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e"
Jul 30 04:36:27.022706 ip-10-0-136-241 kubenswrapper[2571]: E0730 04:36:27.022689    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e\": container with ID starting with 0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e not found: ID does not exist" containerID="0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e"
Jul 30 04:36:27.022781 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.022718    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e"} err="failed to get container status \"0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e\": rpc error: code = NotFound desc = could not find container \"0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e\": container with ID starting with 0f8198f867c39fb804a103e8005d8fa0a440cb95fd9c05f4dff207fe5af2a67e not found: ID does not exist"
Jul 30 04:36:27.034068 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.034037    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"]
Jul 30 04:36:27.037614 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.037591    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fcf3e6/rate-test-model-fcf3e6-kserve-cd9bbc9dc-sn2fz"]
Jul 30 04:36:27.376982 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.376948    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7322-140422138632208"]
Jul 30 04:36:27.377333 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.377320    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8fa63b5-6191-4924-8360-0bd56a9015f9" containerName="main"
Jul 30 04:36:27.377377 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.377334    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8fa63b5-6191-4924-8360-0bd56a9015f9" containerName="main"
Jul 30 04:36:27.377377 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.377344    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916c9a6f-5c94-4198-951d-23d012be66b4" containerName="main"
Jul 30 04:36:27.377377 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.377351    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="916c9a6f-5c94-4198-951d-23d012be66b4" containerName="main"
Jul 30 04:36:27.377474 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.377424    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="916c9a6f-5c94-4198-951d-23d012be66b4" containerName="main"
Jul 30 04:36:27.377474 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.377434    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8fa63b5-6191-4924-8360-0bd56a9015f9" containerName="main"
Jul 30 04:36:27.381449 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.381433    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-140422138632208"
Jul 30 04:36:27.384332 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.384308    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-69vlb\""
Jul 30 04:36:27.386595 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.386571    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7322-140422138632208"]
Jul 30 04:36:27.459345 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.459306    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfzpv\" (UniqueName: \"kubernetes.io/projected/f13b87ef-561b-42e6-8b25-f17291dad3e3-kube-api-access-kfzpv\") pod \"test-curl-7322-140422138632208\" (UID: \"f13b87ef-561b-42e6-8b25-f17291dad3e3\") " pod="opendatahub/test-curl-7322-140422138632208"
Jul 30 04:36:27.560139 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.560106    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfzpv\" (UniqueName: \"kubernetes.io/projected/f13b87ef-561b-42e6-8b25-f17291dad3e3-kube-api-access-kfzpv\") pod \"test-curl-7322-140422138632208\" (UID: \"f13b87ef-561b-42e6-8b25-f17291dad3e3\") " pod="opendatahub/test-curl-7322-140422138632208"
Jul 30 04:36:27.568606 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.568579    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfzpv\" (UniqueName: \"kubernetes.io/projected/f13b87ef-561b-42e6-8b25-f17291dad3e3-kube-api-access-kfzpv\") pod \"test-curl-7322-140422138632208\" (UID: \"f13b87ef-561b-42e6-8b25-f17291dad3e3\") " pod="opendatahub/test-curl-7322-140422138632208"
Jul 30 04:36:27.692606 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.692478    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-140422138632208"
Jul 30 04:36:27.822915 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.822885    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7322-140422138632208"]
Jul 30 04:36:27.825367 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:36:27.825338    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf13b87ef_561b_42e6_8b25_f17291dad3e3.slice/crio-7e2644d7634ffa684f7d2c20e0fe7d6e63e157055d08254b745f83cad48aafe9 WatchSource:0}: Error finding container 7e2644d7634ffa684f7d2c20e0fe7d6e63e157055d08254b745f83cad48aafe9: Status 404 returned error can't find the container with id 7e2644d7634ffa684f7d2c20e0fe7d6e63e157055d08254b745f83cad48aafe9
Jul 30 04:36:27.826744 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:27.826720    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 04:36:28.020811 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:28.020718    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7322-140422138632208" event={"ID":"f13b87ef-561b-42e6-8b25-f17291dad3e3","Type":"ContainerStarted","Data":"7e2644d7634ffa684f7d2c20e0fe7d6e63e157055d08254b745f83cad48aafe9"}
Jul 30 04:36:28.640896 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:28.640860    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="916c9a6f-5c94-4198-951d-23d012be66b4" path="/var/lib/kubelet/pods/916c9a6f-5c94-4198-951d-23d012be66b4/volumes"
Jul 30 04:36:29.027865 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:29.027821    2571 generic.go:356] "Generic (PLEG): container finished" podID="f13b87ef-561b-42e6-8b25-f17291dad3e3" containerID="0de3d68e7bae959d1ae4afeb85ae906a8546e0ad8a24a4f4569b65f523957f4a" exitCode=0
Jul 30 04:36:29.028255 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:29.027909    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7322-140422138632208" event={"ID":"f13b87ef-561b-42e6-8b25-f17291dad3e3","Type":"ContainerDied","Data":"0de3d68e7bae959d1ae4afeb85ae906a8546e0ad8a24a4f4569b65f523957f4a"}
Jul 30 04:36:30.169070 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:30.169041    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-140422138632208"
Jul 30 04:36:30.204358 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:30.204325    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7322-140422138632208_f13b87ef-561b-42e6-8b25-f17291dad3e3/test-curl-7322-140422138632208/0.log"
Jul 30 04:36:30.224118 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:30.224083    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7322-140422138632208"]
Jul 30 04:36:30.227735 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:30.227708    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7322-140422138632208"]
Jul 30 04:36:30.285257 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:30.285158    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfzpv\" (UniqueName: \"kubernetes.io/projected/f13b87ef-561b-42e6-8b25-f17291dad3e3-kube-api-access-kfzpv\") pod \"f13b87ef-561b-42e6-8b25-f17291dad3e3\" (UID: \"f13b87ef-561b-42e6-8b25-f17291dad3e3\") "
Jul 30 04:36:30.287451 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:30.287410    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f13b87ef-561b-42e6-8b25-f17291dad3e3-kube-api-access-kfzpv" (OuterVolumeSpecName: "kube-api-access-kfzpv") pod "f13b87ef-561b-42e6-8b25-f17291dad3e3" (UID: "f13b87ef-561b-42e6-8b25-f17291dad3e3"). InnerVolumeSpecName "kube-api-access-kfzpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 04:36:30.385823 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:30.385766    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfzpv\" (UniqueName: \"kubernetes.io/projected/f13b87ef-561b-42e6-8b25-f17291dad3e3-kube-api-access-kfzpv\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:36:30.641735 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:30.641701    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f13b87ef-561b-42e6-8b25-f17291dad3e3" path="/var/lib/kubelet/pods/f13b87ef-561b-42e6-8b25-f17291dad3e3/volumes"
Jul 30 04:36:31.038835 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:31.038757    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7322-140422138632208"
Jul 30 04:36:31.038835 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:36:31.038787    2571 scope.go:117] "RemoveContainer" containerID="0de3d68e7bae959d1ae4afeb85ae906a8546e0ad8a24a4f4569b65f523957f4a"
Jul 30 04:37:41.923003 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:41.922965    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"]
Jul 30 04:37:41.923447 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:41.923306    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13b87ef-561b-42e6-8b25-f17291dad3e3" containerName="test-curl-7322-140422138632208"
Jul 30 04:37:41.923447 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:41.923318    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13b87ef-561b-42e6-8b25-f17291dad3e3" containerName="test-curl-7322-140422138632208"
Jul 30 04:37:41.923447 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:41.923389    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13b87ef-561b-42e6-8b25-f17291dad3e3" containerName="test-curl-7322-140422138632208"
Jul 30 04:37:41.926440 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:41.926416    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:41.929090 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:41.929064    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-77b2c7\"/\"kube-root-ca.crt\""
Jul 30 04:37:41.930197 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:41.930177    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-77b2c7\"/\"ipp-route-77b2c7-kserve-self-signed-certs\""
Jul 30 04:37:41.930314 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:41.930214    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-77b2c7\"/\"default-dockercfg-xp2pv\""
Jul 30 04:37:41.930314 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:41.930217    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-77b2c7\"/\"openshift-service-ca.crt\""
Jul 30 04:37:41.937936 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:41.937911    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"]
Jul 30 04:37:42.003244 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.003197    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-dshm\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.003244 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.003244    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tls-certs\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.003498 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.003331    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-home\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.003498 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.003367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-model-cache\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.003498 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.003388    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdxj5\" (UniqueName: \"kubernetes.io/projected/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-kube-api-access-bdxj5\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.003498 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.003410    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tmp-dir\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.104623 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.104581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-dshm\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.104623 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.104620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tls-certs\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.104872 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.104650    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-home\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.104872 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.104671    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-model-cache\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.104872 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.104699    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdxj5\" (UniqueName: \"kubernetes.io/projected/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-kube-api-access-bdxj5\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.104872 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.104729    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tmp-dir\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.105143 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.105107    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-home\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.105202 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.105163    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-model-cache\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.105202 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.105177    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tmp-dir\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.106989 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.106963    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-dshm\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.107176 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.107155    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tls-certs\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.111780 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.111758    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdxj5\" (UniqueName: \"kubernetes.io/projected/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-kube-api-access-bdxj5\") pod \"ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") " pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.236462 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.236359    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:42.372360 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:42.372335    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"]
Jul 30 04:37:42.374695 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:37:42.374659    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f7a3b26_ff78_4d8b_845d_94ce87c3b689.slice/crio-2ae0c7dc8045887e8cb4d826c05c13163b48c02afc434538aafae6930c9525b0 WatchSource:0}: Error finding container 2ae0c7dc8045887e8cb4d826c05c13163b48c02afc434538aafae6930c9525b0: Status 404 returned error can't find the container with id 2ae0c7dc8045887e8cb4d826c05c13163b48c02afc434538aafae6930c9525b0
Jul 30 04:37:43.374774 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:43.374738    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k" event={"ID":"6f7a3b26-ff78-4d8b-845d-94ce87c3b689","Type":"ContainerStarted","Data":"7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21"}
Jul 30 04:37:43.374774 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:43.374779    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k" event={"ID":"6f7a3b26-ff78-4d8b-845d-94ce87c3b689","Type":"ContainerStarted","Data":"2ae0c7dc8045887e8cb4d826c05c13163b48c02afc434538aafae6930c9525b0"}
Jul 30 04:37:43.392112 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:43.392053    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k" podStartSLOduration=2.39203528 podStartE2EDuration="2.39203528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 04:37:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 04:37:43.390938312 +0000 UTC m=+3777.229845623" watchObservedRunningTime="2026-07-30 04:37:43.39203528 +0000 UTC m=+3777.230942566"
Jul 30 04:37:52.237159 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:52.237120    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:52.237639 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:52.237175    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:52.249575 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:52.249542    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:37:52.429730 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:37:52.429698    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:38:34.801670 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:34.801639    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"]
Jul 30 04:38:34.805359 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:34.805339    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:34.808000 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:34.807963    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-410e1b-serving-cert\""
Jul 30 04:38:34.808173 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:34.807988    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 04:38:34.809084 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:34.809067    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 04:38:34.809187 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:34.809068    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-76fjd\""
Jul 30 04:38:34.816079 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:34.816049    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"]
Jul 30 04:38:34.898903 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:34.898860    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2vm4\" (UniqueName: \"kubernetes.io/projected/89576880-aefc-4284-b96d-be9c7e6f34fa-kube-api-access-f2vm4\") pod \"maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:34.899116 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:34.898946    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89576880-aefc-4284-b96d-be9c7e6f34fa-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:34.899116 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:34.899037    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89576880-aefc-4284-b96d-be9c7e6f34fa-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:34.999971 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:34.999923    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2vm4\" (UniqueName: \"kubernetes.io/projected/89576880-aefc-4284-b96d-be9c7e6f34fa-kube-api-access-f2vm4\") pod \"maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:35.000157 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:35.000017    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89576880-aefc-4284-b96d-be9c7e6f34fa-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:35.000157 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:35.000073    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89576880-aefc-4284-b96d-be9c7e6f34fa-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:35.000233 ip-10-0-136-241 kubenswrapper[2571]: E0730 04:38:35.000165    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-serving-cert: secret "maas-api-e2e-ipp-cleanup-410e1b-serving-cert" not found
Jul 30 04:38:35.000279 ip-10-0-136-241 kubenswrapper[2571]: E0730 04:38:35.000268    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89576880-aefc-4284-b96d-be9c7e6f34fa-maas-api-tls podName:89576880-aefc-4284-b96d-be9c7e6f34fa nodeName:}" failed. No retries permitted until 2026-07-30 04:38:35.500251963 +0000 UTC m=+3829.339159249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/89576880-aefc-4284-b96d-be9c7e6f34fa-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx" (UID: "89576880-aefc-4284-b96d-be9c7e6f34fa") : secret "maas-api-e2e-ipp-cleanup-410e1b-serving-cert" not found
Jul 30 04:38:35.000817 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:35.000799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89576880-aefc-4284-b96d-be9c7e6f34fa-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:35.009226 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:35.009196    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2vm4\" (UniqueName: \"kubernetes.io/projected/89576880-aefc-4284-b96d-be9c7e6f34fa-kube-api-access-f2vm4\") pod \"maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:35.502521 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:35.502488    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89576880-aefc-4284-b96d-be9c7e6f34fa-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:35.505005 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:35.504978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89576880-aefc-4284-b96d-be9c7e6f34fa-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:35.718691 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:35.718651    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:35.856460 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:35.856428    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"]
Jul 30 04:38:35.858655 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:38:35.858618    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89576880_aefc_4284_b96d_be9c7e6f34fa.slice/crio-b22bc24b30a369bf7ecfe3d266c8b100581be2dafa32ce0fd61b08eb43ae8655 WatchSource:0}: Error finding container b22bc24b30a369bf7ecfe3d266c8b100581be2dafa32ce0fd61b08eb43ae8655: Status 404 returned error can't find the container with id b22bc24b30a369bf7ecfe3d266c8b100581be2dafa32ce0fd61b08eb43ae8655
Jul 30 04:38:36.643188 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:36.643144    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx" event={"ID":"89576880-aefc-4284-b96d-be9c7e6f34fa","Type":"ContainerStarted","Data":"b22bc24b30a369bf7ecfe3d266c8b100581be2dafa32ce0fd61b08eb43ae8655"}
Jul 30 04:38:38.649201 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:38.649159    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx" event={"ID":"89576880-aefc-4284-b96d-be9c7e6f34fa","Type":"ContainerStarted","Data":"7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8"}
Jul 30 04:38:38.649703 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:38.649290    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:38.668810 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:38.668752    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx" podStartSLOduration=2.322557396 podStartE2EDuration="4.668731938s" totalImagesPullingTime="2.346174542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 04:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 04:38:38.667282303 +0000 UTC m=+3832.506189591" watchObservedRunningTime="2026-07-30 04:38:38.668731938 +0000 UTC m=+3832.507639229"
Jul 30 04:38:44.660404 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:44.660369    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:38:59.274416 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:59.274377    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"]
Jul 30 04:38:59.278068 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:59.278047    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"
Jul 30 04:38:59.280721 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:59.280692    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5cg4s\""
Jul 30 04:38:59.285180 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:59.285151    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"]
Jul 30 04:38:59.417462 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:59.417423    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/124a4c60-e364-4045-8cf7-175a87d77e3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5\" (UID: \"124a4c60-e364-4045-8cf7-175a87d77e3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"
Jul 30 04:38:59.518884 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:59.518847    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/124a4c60-e364-4045-8cf7-175a87d77e3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5\" (UID: \"124a4c60-e364-4045-8cf7-175a87d77e3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"
Jul 30 04:38:59.519452 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:59.519433    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/124a4c60-e364-4045-8cf7-175a87d77e3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5\" (UID: \"124a4c60-e364-4045-8cf7-175a87d77e3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"
Jul 30 04:38:59.589585 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:59.589472    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"
Jul 30 04:38:59.730282 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:59.730244    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"]
Jul 30 04:38:59.733557 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:38:59.733505    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124a4c60_e364_4045_8cf7_175a87d77e3c.slice/crio-f98a301ef507888477b6b6e96fa862e92829eeadf7b00793f26ffd5386f29eaa WatchSource:0}: Error finding container f98a301ef507888477b6b6e96fa862e92829eeadf7b00793f26ffd5386f29eaa: Status 404 returned error can't find the container with id f98a301ef507888477b6b6e96fa862e92829eeadf7b00793f26ffd5386f29eaa
Jul 30 04:38:59.745334 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:38:59.745300    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5" event={"ID":"124a4c60-e364-4045-8cf7-175a87d77e3c","Type":"ContainerStarted","Data":"f98a301ef507888477b6b6e96fa862e92829eeadf7b00793f26ffd5386f29eaa"}
Jul 30 04:39:02.762200 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:02.762164    2571 generic.go:356] "Generic (PLEG): container finished" podID="124a4c60-e364-4045-8cf7-175a87d77e3c" containerID="9e3f0a9d4bd44eb39e2d233b155a515ab87c8dd93153dfa196f899b911521376" exitCode=0
Jul 30 04:39:02.762640 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:02.762249    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5" event={"ID":"124a4c60-e364-4045-8cf7-175a87d77e3c","Type":"ContainerDied","Data":"9e3f0a9d4bd44eb39e2d233b155a515ab87c8dd93153dfa196f899b911521376"}
Jul 30 04:39:03.898864 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:03.898832    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"
Jul 30 04:39:03.956712 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:03.956674    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/124a4c60-e364-4045-8cf7-175a87d77e3c-maas-api-service-ca\") pod \"124a4c60-e364-4045-8cf7-175a87d77e3c\" (UID: \"124a4c60-e364-4045-8cf7-175a87d77e3c\") "
Jul 30 04:39:03.957159 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:03.957110    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/124a4c60-e364-4045-8cf7-175a87d77e3c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "124a4c60-e364-4045-8cf7-175a87d77e3c" (UID: "124a4c60-e364-4045-8cf7-175a87d77e3c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 04:39:04.058170 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:04.058071    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/124a4c60-e364-4045-8cf7-175a87d77e3c-maas-api-service-ca\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:39:04.772796 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:04.772762    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"
Jul 30 04:39:04.772796 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:04.772780    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5" event={"ID":"124a4c60-e364-4045-8cf7-175a87d77e3c","Type":"ContainerDied","Data":"f98a301ef507888477b6b6e96fa862e92829eeadf7b00793f26ffd5386f29eaa"}
Jul 30 04:39:04.773047 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:04.772831    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f98a301ef507888477b6b6e96fa862e92829eeadf7b00793f26ffd5386f29eaa"
Jul 30 04:39:15.412869 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.412774    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"]
Jul 30 04:39:15.413367 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.413084    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx" podUID="89576880-aefc-4284-b96d-be9c7e6f34fa" containerName="maas-api" containerID="cri-o://7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8" gracePeriod=30
Jul 30 04:39:15.604470 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.604434    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"]
Jul 30 04:39:15.606805 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.606772    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-410e1b-j7jp5"]
Jul 30 04:39:15.672604 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.672516    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:39:15.763140 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.763102    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89576880-aefc-4284-b96d-be9c7e6f34fa-maas-api-tls\") pod \"89576880-aefc-4284-b96d-be9c7e6f34fa\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") "
Jul 30 04:39:15.763344 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.763182    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89576880-aefc-4284-b96d-be9c7e6f34fa-openshift-service-ca\") pod \"89576880-aefc-4284-b96d-be9c7e6f34fa\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") "
Jul 30 04:39:15.763344 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.763236    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2vm4\" (UniqueName: \"kubernetes.io/projected/89576880-aefc-4284-b96d-be9c7e6f34fa-kube-api-access-f2vm4\") pod \"89576880-aefc-4284-b96d-be9c7e6f34fa\" (UID: \"89576880-aefc-4284-b96d-be9c7e6f34fa\") "
Jul 30 04:39:15.763573 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.763542    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89576880-aefc-4284-b96d-be9c7e6f34fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89576880-aefc-4284-b96d-be9c7e6f34fa" (UID: "89576880-aefc-4284-b96d-be9c7e6f34fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 04:39:15.765567 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.765503    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89576880-aefc-4284-b96d-be9c7e6f34fa-kube-api-access-f2vm4" (OuterVolumeSpecName: "kube-api-access-f2vm4") pod "89576880-aefc-4284-b96d-be9c7e6f34fa" (UID: "89576880-aefc-4284-b96d-be9c7e6f34fa"). InnerVolumeSpecName "kube-api-access-f2vm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 04:39:15.765840 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.765603    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89576880-aefc-4284-b96d-be9c7e6f34fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89576880-aefc-4284-b96d-be9c7e6f34fa" (UID: "89576880-aefc-4284-b96d-be9c7e6f34fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 04:39:15.824941 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.824904    2571 generic.go:356] "Generic (PLEG): container finished" podID="89576880-aefc-4284-b96d-be9c7e6f34fa" containerID="7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8" exitCode=0
Jul 30 04:39:15.824941 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.824942    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"
Jul 30 04:39:15.825157 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.824981    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx" event={"ID":"89576880-aefc-4284-b96d-be9c7e6f34fa","Type":"ContainerDied","Data":"7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8"}
Jul 30 04:39:15.825157 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.825036    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx" event={"ID":"89576880-aefc-4284-b96d-be9c7e6f34fa","Type":"ContainerDied","Data":"b22bc24b30a369bf7ecfe3d266c8b100581be2dafa32ce0fd61b08eb43ae8655"}
Jul 30 04:39:15.825157 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.825059    2571 scope.go:117] "RemoveContainer" containerID="7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8"
Jul 30 04:39:15.835248 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.835231    2571 scope.go:117] "RemoveContainer" containerID="7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8"
Jul 30 04:39:15.835598 ip-10-0-136-241 kubenswrapper[2571]: E0730 04:39:15.835576    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8\": container with ID starting with 7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8 not found: ID does not exist" containerID="7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8"
Jul 30 04:39:15.835667 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.835609    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8"} err="failed to get container status \"7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8\": rpc error: code = NotFound desc = could not find container \"7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8\": container with ID starting with 7657619de5b8cddbec2ab474bc82243c84cbc4289aad0b8f67f2a79a3817cee8 not found: ID does not exist"
Jul 30 04:39:15.852759 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.852725    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"]
Jul 30 04:39:15.861558 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.859629    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-410e1b-6978c85979-jxqsx"]
Jul 30 04:39:15.864102 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.864074    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89576880-aefc-4284-b96d-be9c7e6f34fa-openshift-service-ca\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:39:15.864102 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.864102    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2vm4\" (UniqueName: \"kubernetes.io/projected/89576880-aefc-4284-b96d-be9c7e6f34fa-kube-api-access-f2vm4\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:39:15.864261 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:15.864115    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89576880-aefc-4284-b96d-be9c7e6f34fa-maas-api-tls\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:39:16.642200 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:16.642165    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="124a4c60-e364-4045-8cf7-175a87d77e3c" path="/var/lib/kubelet/pods/124a4c60-e364-4045-8cf7-175a87d77e3c/volumes"
Jul 30 04:39:16.642631 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:16.642595    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89576880-aefc-4284-b96d-be9c7e6f34fa" path="/var/lib/kubelet/pods/89576880-aefc-4284-b96d-be9c7e6f34fa/volumes"
Jul 30 04:39:46.430070 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:46.430033    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"]
Jul 30 04:39:46.838148 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:46.837999    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:39:46.846137 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:46.846108    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:39:46.856038 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:46.856016    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:39:46.862761 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:39:46.862741    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6tl9_2e9e7985-57b1-4487-9907-6c9d98c2ed29/ovn-acl-logging/0.log"
Jul 30 04:40:01.449364 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.449319    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k" podUID="6f7a3b26-ff78-4d8b-845d-94ce87c3b689" containerName="main" containerID="cri-o://7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21" gracePeriod=45
Jul 30 04:40:01.696857 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.696828    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:40:01.861262 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.861165    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-dshm\") pod \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") "
Jul 30 04:40:01.861262 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.861240    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-model-cache\") pod \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") "
Jul 30 04:40:01.861547 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.861270    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdxj5\" (UniqueName: \"kubernetes.io/projected/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-kube-api-access-bdxj5\") pod \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") "
Jul 30 04:40:01.861547 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.861292    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tmp-dir\") pod \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") "
Jul 30 04:40:01.861547 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.861350    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-home\") pod \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") "
Jul 30 04:40:01.861547 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.861371    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tls-certs\") pod \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\" (UID: \"6f7a3b26-ff78-4d8b-845d-94ce87c3b689\") "
Jul 30 04:40:01.861756 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.861617    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f7a3b26-ff78-4d8b-845d-94ce87c3b689" (UID: "6f7a3b26-ff78-4d8b-845d-94ce87c3b689"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:40:01.861756 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.861650    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-home" (OuterVolumeSpecName: "home") pod "6f7a3b26-ff78-4d8b-845d-94ce87c3b689" (UID: "6f7a3b26-ff78-4d8b-845d-94ce87c3b689"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:40:01.861756 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.861667    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f7a3b26-ff78-4d8b-845d-94ce87c3b689" (UID: "6f7a3b26-ff78-4d8b-845d-94ce87c3b689"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:40:01.863594 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.863563    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-dshm" (OuterVolumeSpecName: "dshm") pod "6f7a3b26-ff78-4d8b-845d-94ce87c3b689" (UID: "6f7a3b26-ff78-4d8b-845d-94ce87c3b689"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 04:40:01.863713 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.863692    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f7a3b26-ff78-4d8b-845d-94ce87c3b689" (UID: "6f7a3b26-ff78-4d8b-845d-94ce87c3b689"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 04:40:01.863713 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.863699    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-kube-api-access-bdxj5" (OuterVolumeSpecName: "kube-api-access-bdxj5") pod "6f7a3b26-ff78-4d8b-845d-94ce87c3b689" (UID: "6f7a3b26-ff78-4d8b-845d-94ce87c3b689"). InnerVolumeSpecName "kube-api-access-bdxj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 04:40:01.962417 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.962375    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-dshm\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:40:01.962417 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.962405    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-model-cache\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:40:01.962417 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.962417    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdxj5\" (UniqueName: \"kubernetes.io/projected/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-kube-api-access-bdxj5\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:40:01.962417 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.962425    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tmp-dir\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:40:01.962768 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.962437    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-home\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:40:01.962768 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:01.962445    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f7a3b26-ff78-4d8b-845d-94ce87c3b689-tls-certs\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:40:02.036940 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:02.036906    2571 generic.go:356] "Generic (PLEG): container finished" podID="6f7a3b26-ff78-4d8b-845d-94ce87c3b689" containerID="7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21" exitCode=0
Jul 30 04:40:02.037124 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:02.036952    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"
Jul 30 04:40:02.037124 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:02.036998    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k" event={"ID":"6f7a3b26-ff78-4d8b-845d-94ce87c3b689","Type":"ContainerDied","Data":"7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21"}
Jul 30 04:40:02.037124 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:02.037045    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k" event={"ID":"6f7a3b26-ff78-4d8b-845d-94ce87c3b689","Type":"ContainerDied","Data":"2ae0c7dc8045887e8cb4d826c05c13163b48c02afc434538aafae6930c9525b0"}
Jul 30 04:40:02.037124 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:02.037066    2571 scope.go:117] "RemoveContainer" containerID="7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21"
Jul 30 04:40:02.050354 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:02.050330    2571 scope.go:117] "RemoveContainer" containerID="7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21"
Jul 30 04:40:02.050708 ip-10-0-136-241 kubenswrapper[2571]: E0730 04:40:02.050684    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21\": container with ID starting with 7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21 not found: ID does not exist" containerID="7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21"
Jul 30 04:40:02.050831 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:02.050715    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21"} err="failed to get container status \"7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21\": rpc error: code = NotFound desc = could not find container \"7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21\": container with ID starting with 7a1e6f88fb626392c99ac5fa3b720ac899a27a36329410c5b9aa43857cbf2c21 not found: ID does not exist"
Jul 30 04:40:02.065245 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:02.065208    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"]
Jul 30 04:40:02.068804 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:02.068777    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-77b2c7/ipp-route-77b2c7-kserve-5c8c8d79bc-pmv6k"]
Jul 30 04:40:02.641480 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:02.641446    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f7a3b26-ff78-4d8b-845d-94ce87c3b689" path="/var/lib/kubelet/pods/6f7a3b26-ff78-4d8b-845d-94ce87c3b689/volumes"
Jul 30 04:40:29.771260 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.771220    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"]
Jul 30 04:40:29.771780 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.771601    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89576880-aefc-4284-b96d-be9c7e6f34fa" containerName="maas-api"
Jul 30 04:40:29.771780 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.771613    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="89576880-aefc-4284-b96d-be9c7e6f34fa" containerName="maas-api"
Jul 30 04:40:29.771780 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.771634    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f7a3b26-ff78-4d8b-845d-94ce87c3b689" containerName="main"
Jul 30 04:40:29.771780 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.771640    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f7a3b26-ff78-4d8b-845d-94ce87c3b689" containerName="main"
Jul 30 04:40:29.771780 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.771646    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="124a4c60-e364-4045-8cf7-175a87d77e3c" containerName="revoke-keys"
Jul 30 04:40:29.771780 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.771652    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="124a4c60-e364-4045-8cf7-175a87d77e3c" containerName="revoke-keys"
Jul 30 04:40:29.771780 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.771704    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f7a3b26-ff78-4d8b-845d-94ce87c3b689" containerName="main"
Jul 30 04:40:29.771780 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.771712    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="89576880-aefc-4284-b96d-be9c7e6f34fa" containerName="maas-api"
Jul 30 04:40:29.771780 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.771722    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="124a4c60-e364-4045-8cf7-175a87d77e3c" containerName="revoke-keys"
Jul 30 04:40:29.773979 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.773963    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"
Jul 30 04:40:29.776843 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.776811    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 04:40:29.776967 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.776858    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5cg4s\""
Jul 30 04:40:29.785875 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.785848    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"]
Jul 30 04:40:29.807024 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.806988    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/423a10a5-f858-47ed-91dc-320df70cca79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5\" (UID: \"423a10a5-f858-47ed-91dc-320df70cca79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"
Jul 30 04:40:29.908483 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.908447    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/423a10a5-f858-47ed-91dc-320df70cca79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5\" (UID: \"423a10a5-f858-47ed-91dc-320df70cca79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"
Jul 30 04:40:29.909158 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:29.909129    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/423a10a5-f858-47ed-91dc-320df70cca79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5\" (UID: \"423a10a5-f858-47ed-91dc-320df70cca79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"
Jul 30 04:40:30.084706 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:30.084599    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"
Jul 30 04:40:30.218853 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:30.218647    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"]
Jul 30 04:40:30.221786 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:40:30.221758    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423a10a5_f858_47ed_91dc_320df70cca79.slice/crio-d2e40667070bd10492dc494f025c9a0e8069ced6612c40d38be905dc97c84bb5 WatchSource:0}: Error finding container d2e40667070bd10492dc494f025c9a0e8069ced6612c40d38be905dc97c84bb5: Status 404 returned error can't find the container with id d2e40667070bd10492dc494f025c9a0e8069ced6612c40d38be905dc97c84bb5
Jul 30 04:40:31.175927 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:31.175895    2571 generic.go:356] "Generic (PLEG): container finished" podID="423a10a5-f858-47ed-91dc-320df70cca79" containerID="05853dee52ee413aba85cfc73ade9a6398fe56046a9ba5ad3e0de219286a65af" exitCode=0
Jul 30 04:40:31.176334 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:31.175972    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5" event={"ID":"423a10a5-f858-47ed-91dc-320df70cca79","Type":"ContainerDied","Data":"05853dee52ee413aba85cfc73ade9a6398fe56046a9ba5ad3e0de219286a65af"}
Jul 30 04:40:31.176334 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:31.176034    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5" event={"ID":"423a10a5-f858-47ed-91dc-320df70cca79","Type":"ContainerStarted","Data":"d2e40667070bd10492dc494f025c9a0e8069ced6612c40d38be905dc97c84bb5"}
Jul 30 04:40:32.319289 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:32.319261    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"
Jul 30 04:40:32.433369 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:32.433336    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/423a10a5-f858-47ed-91dc-320df70cca79-maas-api-service-ca\") pod \"423a10a5-f858-47ed-91dc-320df70cca79\" (UID: \"423a10a5-f858-47ed-91dc-320df70cca79\") "
Jul 30 04:40:32.433777 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:32.433718    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/423a10a5-f858-47ed-91dc-320df70cca79-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "423a10a5-f858-47ed-91dc-320df70cca79" (UID: "423a10a5-f858-47ed-91dc-320df70cca79"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 04:40:32.534068 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:32.534033    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/423a10a5-f858-47ed-91dc-320df70cca79-maas-api-service-ca\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:40:33.189706 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:33.189667    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5" event={"ID":"423a10a5-f858-47ed-91dc-320df70cca79","Type":"ContainerDied","Data":"d2e40667070bd10492dc494f025c9a0e8069ced6612c40d38be905dc97c84bb5"}
Jul 30 04:40:33.189915 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:33.189725    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2e40667070bd10492dc494f025c9a0e8069ced6612c40d38be905dc97c84bb5"
Jul 30 04:40:33.189915 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:33.189679    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"
Jul 30 04:40:35.499587 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:35.499554    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"]
Jul 30 04:40:35.502184 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:35.502154    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-1d8c4c-gpfh5"]
Jul 30 04:40:36.641970 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:36.641935    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="423a10a5-f858-47ed-91dc-320df70cca79" path="/var/lib/kubelet/pods/423a10a5-f858-47ed-91dc-320df70cca79/volumes"
Jul 30 04:40:42.330456 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.330416    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"]
Jul 30 04:40:42.330879 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.330761    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423a10a5-f858-47ed-91dc-320df70cca79" containerName="revoke-keys"
Jul 30 04:40:42.330879 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.330772    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="423a10a5-f858-47ed-91dc-320df70cca79" containerName="revoke-keys"
Jul 30 04:40:42.330879 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.330844    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="423a10a5-f858-47ed-91dc-320df70cca79" containerName="revoke-keys"
Jul 30 04:40:42.332877 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.332854    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"
Jul 30 04:40:42.335477 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.335454    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 04:40:42.335635 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.335561    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5cg4s\""
Jul 30 04:40:42.341956 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.341929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"]
Jul 30 04:40:42.420541 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.420502    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d82da6f-a64e-4422-876e-20eab661f917-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq\" (UID: \"5d82da6f-a64e-4422-876e-20eab661f917\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"
Jul 30 04:40:42.521016 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.520971    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d82da6f-a64e-4422-876e-20eab661f917-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq\" (UID: \"5d82da6f-a64e-4422-876e-20eab661f917\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"
Jul 30 04:40:42.521744 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.521714    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d82da6f-a64e-4422-876e-20eab661f917-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq\" (UID: \"5d82da6f-a64e-4422-876e-20eab661f917\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"
Jul 30 04:40:42.645786 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.645754    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"
Jul 30 04:40:42.781174 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:42.781141    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"]
Jul 30 04:40:42.783176 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:40:42.783150    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d82da6f_a64e_4422_876e_20eab661f917.slice/crio-ad9dc53d44fc22a77f982566c6ae839d701b214730c24a77e958e55c79c26b6c WatchSource:0}: Error finding container ad9dc53d44fc22a77f982566c6ae839d701b214730c24a77e958e55c79c26b6c: Status 404 returned error can't find the container with id ad9dc53d44fc22a77f982566c6ae839d701b214730c24a77e958e55c79c26b6c
Jul 30 04:40:43.243824 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:43.243788    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq" event={"ID":"5d82da6f-a64e-4422-876e-20eab661f917","Type":"ContainerStarted","Data":"2cf3df18a3f7a490efce0848465bbfd782727c90423698e1fe07c83c23aafcb8"}
Jul 30 04:40:43.244037 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:43.243841    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq" event={"ID":"5d82da6f-a64e-4422-876e-20eab661f917","Type":"ContainerStarted","Data":"ad9dc53d44fc22a77f982566c6ae839d701b214730c24a77e958e55c79c26b6c"}
Jul 30 04:40:43.259886 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:43.259824    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq" podStartSLOduration=1.2598069060000001 podStartE2EDuration="1.259806906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 04:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 04:40:43.257981781 +0000 UTC m=+3957.096889073" watchObservedRunningTime="2026-07-30 04:40:43.259806906 +0000 UTC m=+3957.098714193"
Jul 30 04:40:44.250354 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:44.250311    2571 generic.go:356] "Generic (PLEG): container finished" podID="5d82da6f-a64e-4422-876e-20eab661f917" containerID="2cf3df18a3f7a490efce0848465bbfd782727c90423698e1fe07c83c23aafcb8" exitCode=0
Jul 30 04:40:44.250788 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:44.250394    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq" event={"ID":"5d82da6f-a64e-4422-876e-20eab661f917","Type":"ContainerDied","Data":"2cf3df18a3f7a490efce0848465bbfd782727c90423698e1fe07c83c23aafcb8"}
Jul 30 04:40:45.388630 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:45.388603    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"
Jul 30 04:40:45.547260 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:45.547168    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d82da6f-a64e-4422-876e-20eab661f917-maas-api-service-ca\") pod \"5d82da6f-a64e-4422-876e-20eab661f917\" (UID: \"5d82da6f-a64e-4422-876e-20eab661f917\") "
Jul 30 04:40:45.547562 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:45.547510    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d82da6f-a64e-4422-876e-20eab661f917-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d82da6f-a64e-4422-876e-20eab661f917" (UID: "5d82da6f-a64e-4422-876e-20eab661f917"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 04:40:45.647985 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:45.647946    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d82da6f-a64e-4422-876e-20eab661f917-maas-api-service-ca\") on node \"ip-10-0-136-241.ec2.internal\" DevicePath \"\""
Jul 30 04:40:46.262255 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:46.262208    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq" event={"ID":"5d82da6f-a64e-4422-876e-20eab661f917","Type":"ContainerDied","Data":"ad9dc53d44fc22a77f982566c6ae839d701b214730c24a77e958e55c79c26b6c"}
Jul 30 04:40:46.262433 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:46.262266    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad9dc53d44fc22a77f982566c6ae839d701b214730c24a77e958e55c79c26b6c"
Jul 30 04:40:46.262433 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:46.262217    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"
Jul 30 04:40:52.946812 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:52.946775    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"]
Jul 30 04:40:52.950110 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:52.950079    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-19ef02-zf9sq"]
Jul 30 04:40:54.641602 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:40:54.641565    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d82da6f-a64e-4422-876e-20eab661f917" path="/var/lib/kubelet/pods/5d82da6f-a64e-4422-876e-20eab661f917/volumes"
Jul 30 04:41:22.834060 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:22.834028    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sszn6_d5db0a53-ee21-4b98-a9c4-ca614594d45c/server/0.log"
Jul 30 04:41:22.949287 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:22.949251    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xq4qk_8b6e2081-92e2-4a74-8d17-a28ae31b8223/manager/0.log"
Jul 30 04:41:23.162003 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:23.161969    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5946c6c8fb-gd5hx_d66d45a0-65ba-4f38-9400-22bd28fb0330/copy-manifests/0.log"
Jul 30 04:41:23.168963 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:23.168936    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5946c6c8fb-gd5hx_d66d45a0-65ba-4f38-9400-22bd28fb0330/manager/0.log"
Jul 30 04:41:26.472795 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:26.472756    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wlhwj_62da92f4-9217-4985-8aa2-c5db796fc211/discovery/0.log"
Jul 30 04:41:26.576577 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:26.576515    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fb6bd797-4fslr_b930714f-b7ee-4aa3-a830-1b3fc554a87a/kube-auth-proxy/0.log"
Jul 30 04:41:27.119153 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:27.119122    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8558776bb7-zts8f_90ba3f14-0f5d-4fb7-a723-774259f302e7/router/0.log"
Jul 30 04:41:35.816512 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:35.816480    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h6twk_b07ce16c-1a8d-452d-b97e-8048abd8d86a/global-pull-secret-syncer/0.log"
Jul 30 04:41:36.036947 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:36.036905    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w22qn_551297f1-e510-43c5-a973-a242b44b4576/konnectivity-agent/0.log"
Jul 30 04:41:36.059125 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:36.059092    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-241.ec2.internal_d6436331a3fffddc9a43cdb229905c3b/haproxy/0.log"
Jul 30 04:41:43.169909 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:43.169870    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-87r8g_6ec6d01b-1aa1-4fa5-a91b-730b736604fe/cluster-monitoring-operator/0.log"
Jul 30 04:41:43.464198 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:43.464102    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qm5zx_e8650a70-864f-4ca6-b6ab-79f605105612/node-exporter/0.log"
Jul 30 04:41:43.482021 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:43.481987    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qm5zx_e8650a70-864f-4ca6-b6ab-79f605105612/kube-rbac-proxy/0.log"
Jul 30 04:41:43.500622 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:43.500597    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qm5zx_e8650a70-864f-4ca6-b6ab-79f605105612/init-textfile/0.log"
Jul 30 04:41:43.834832 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:43.834741    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-hz2ps_b9594df7-b6a2-4245-a6a5-cca0e387ec17/prometheus-operator/0.log"
Jul 30 04:41:43.848664 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:43.848624    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-hz2ps_b9594df7-b6a2-4245-a6a5-cca0e387ec17/kube-rbac-proxy/0.log"
Jul 30 04:41:43.970447 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:43.970420    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579ddf4cf5-6jqxk_5d33ec94-b056-42fc-957f-ac6c6bf4b7fa/thanos-query/0.log"
Jul 30 04:41:43.990474 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:43.990444    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579ddf4cf5-6jqxk_5d33ec94-b056-42fc-957f-ac6c6bf4b7fa/kube-rbac-proxy-web/0.log"
Jul 30 04:41:44.011436 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:44.011409    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579ddf4cf5-6jqxk_5d33ec94-b056-42fc-957f-ac6c6bf4b7fa/kube-rbac-proxy/0.log"
Jul 30 04:41:44.032727 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:44.032696    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579ddf4cf5-6jqxk_5d33ec94-b056-42fc-957f-ac6c6bf4b7fa/prom-label-proxy/0.log"
Jul 30 04:41:44.054932 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:44.054905    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579ddf4cf5-6jqxk_5d33ec94-b056-42fc-957f-ac6c6bf4b7fa/kube-rbac-proxy-rules/0.log"
Jul 30 04:41:44.073899 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:44.073869    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579ddf4cf5-6jqxk_5d33ec94-b056-42fc-957f-ac6c6bf4b7fa/kube-rbac-proxy-metrics/0.log"
Jul 30 04:41:45.247691 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:45.247655    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-sj8lz_d97b0e22-d5ae-4a1c-b08a-97c3878c857e/networking-console-plugin/0.log"
Jul 30 04:41:45.788014 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:45.787980    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/2.log"
Jul 30 04:41:45.795263 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:45.795235    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-q2h8n_3fe25127-ce0b-448a-965d-28b276bea49f/console-operator/3.log"
Jul 30 04:41:46.011291 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.011252    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"]
Jul 30 04:41:46.011619 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.011606    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d82da6f-a64e-4422-876e-20eab661f917" containerName="revoke-keys"
Jul 30 04:41:46.011673 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.011620    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d82da6f-a64e-4422-876e-20eab661f917" containerName="revoke-keys"
Jul 30 04:41:46.011709 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.011676    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d82da6f-a64e-4422-876e-20eab661f917" containerName="revoke-keys"
Jul 30 04:41:46.013825 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.013801    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.016697 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.016671    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ckfp2\"/\"kube-root-ca.crt\""
Jul 30 04:41:46.016893 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.016763    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ckfp2\"/\"default-dockercfg-pr8bt\""
Jul 30 04:41:46.017026 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.017009    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ckfp2\"/\"openshift-service-ca.crt\""
Jul 30 04:41:46.022871 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.022847    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"]
Jul 30 04:41:46.167222 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.167181    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-podres\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.167432 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.167237    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-sys\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.167432 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.167295    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-proc\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.167432 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.167356    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-lib-modules\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.167432 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.167378    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6gcl\" (UniqueName: \"kubernetes.io/projected/3572a28e-d910-4eb2-a919-46630ddcc4d0-kube-api-access-v6gcl\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.268542 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.268487    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-lib-modules\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.268542 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.268543    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gcl\" (UniqueName: \"kubernetes.io/projected/3572a28e-d910-4eb2-a919-46630ddcc4d0-kube-api-access-v6gcl\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.269005 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.268584    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-podres\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.269005 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.268622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-sys\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.269005 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.268668    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-proc\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.269005 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.268684    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-lib-modules\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.269005 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.268715    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-podres\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.269005 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.268769    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-proc\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.269005 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.268770    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3572a28e-d910-4eb2-a919-46630ddcc4d0-sys\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.276627 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.276602    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6gcl\" (UniqueName: \"kubernetes.io/projected/3572a28e-d910-4eb2-a919-46630ddcc4d0-kube-api-access-v6gcl\") pod \"perf-node-gather-daemonset-7fd8m\" (UID: \"3572a28e-d910-4eb2-a919-46630ddcc4d0\") " pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.324710 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.324666    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.416626 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.416596    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-kh85j_0cdbf51a-6c68-4713-9153-8efba2922d4f/download-server/0.log"
Jul 30 04:41:46.464812 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.464786    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"]
Jul 30 04:41:46.467559 ip-10-0-136-241 kubenswrapper[2571]: W0730 04:41:46.467508    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3572a28e_d910_4eb2_a919_46630ddcc4d0.slice/crio-017c18e5bef95972bf735d523678c26e9b38ea3653c3c8cfeec293fe42ad58e0 WatchSource:0}: Error finding container 017c18e5bef95972bf735d523678c26e9b38ea3653c3c8cfeec293fe42ad58e0: Status 404 returned error can't find the container with id 017c18e5bef95972bf735d523678c26e9b38ea3653c3c8cfeec293fe42ad58e0
Jul 30 04:41:46.554073 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.554040    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m" event={"ID":"3572a28e-d910-4eb2-a919-46630ddcc4d0","Type":"ContainerStarted","Data":"ba3b4c1a7ccb3a5741e835d435e02f193e2a017485a771eb52664a0d6b680728"}
Jul 30 04:41:46.554266 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.554097    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m" event={"ID":"3572a28e-d910-4eb2-a919-46630ddcc4d0","Type":"ContainerStarted","Data":"017c18e5bef95972bf735d523678c26e9b38ea3653c3c8cfeec293fe42ad58e0"}
Jul 30 04:41:46.554266 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.554118    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:46.570685 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:46.570620    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m" podStartSLOduration=1.570605486 podStartE2EDuration="1.570605486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 04:41:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 04:41:46.568743251 +0000 UTC m=+4020.407650539" watchObservedRunningTime="2026-07-30 04:41:46.570605486 +0000 UTC m=+4020.409512772"
Jul 30 04:41:48.123152 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:48.123116    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lrf96_27d269fe-b373-4cac-baa6-4d494c197cbb/dns/0.log"
Jul 30 04:41:48.143423 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:48.143393    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lrf96_27d269fe-b373-4cac-baa6-4d494c197cbb/kube-rbac-proxy/0.log"
Jul 30 04:41:48.278845 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:48.278809    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-twskj_79d7f2dc-7fe3-4a4c-b979-22d22fbb15ab/dns-node-resolver/0.log"
Jul 30 04:41:48.822165 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:48.822127    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-82j8x_06734eec-1df6-46d2-806d-9c83d5ee5f6b/node-ca/0.log"
Jul 30 04:41:50.033332 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:50.033296    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wlhwj_62da92f4-9217-4985-8aa2-c5db796fc211/discovery/0.log"
Jul 30 04:41:50.055487 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:50.055444    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fb6bd797-4fslr_b930714f-b7ee-4aa3-a830-1b3fc554a87a/kube-auth-proxy/0.log"
Jul 30 04:41:50.234297 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:50.234264    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8558776bb7-zts8f_90ba3f14-0f5d-4fb7-a723-774259f302e7/router/0.log"
Jul 30 04:41:51.084285 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:51.084257    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l9dpx_2d51a280-0b63-42bc-9cf0-c5cb62ec8789/serve-healthcheck-canary/0.log"
Jul 30 04:41:51.563665 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:51.563630    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-jkcpc_6b42a150-6153-4428-9e0b-e13307f18e96/insights-operator/0.log"
Jul 30 04:41:51.565318 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:51.565293    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-jkcpc_6b42a150-6153-4428-9e0b-e13307f18e96/insights-operator/1.log"
Jul 30 04:41:51.584810 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:51.584773    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4j7w8_68372db1-feb8-4217-8af7-f9024c7c7a25/kube-rbac-proxy/0.log"
Jul 30 04:41:51.607267 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:51.607236    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4j7w8_68372db1-feb8-4217-8af7-f9024c7c7a25/exporter/0.log"
Jul 30 04:41:51.630610 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:51.630578    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4j7w8_68372db1-feb8-4217-8af7-f9024c7c7a25/extractor/0.log"
Jul 30 04:41:52.569409 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:52.569375    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ckfp2/perf-node-gather-daemonset-7fd8m"
Jul 30 04:41:54.494208 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:54.494179    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sszn6_d5db0a53-ee21-4b98-a9c4-ca614594d45c/server/0.log"
Jul 30 04:41:54.619411 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:54.619379    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xq4qk_8b6e2081-92e2-4a74-8d17-a28ae31b8223/manager/0.log"
Jul 30 04:41:54.690076 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:54.690015    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5946c6c8fb-gd5hx_d66d45a0-65ba-4f38-9400-22bd28fb0330/manager/0.log"
Jul 30 04:41:54.709369 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:54.709336    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5946c6c8fb-gd5hx_d66d45a0-65ba-4f38-9400-22bd28fb0330/copy-manifests/0.log"
Jul 30 04:41:56.238334 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:56.238297    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bb6c44f89-gjjrn_0f5a8ed4-3a27-4d8f-8d04-61852b1f7c47/manager/0.log"
Jul 30 04:41:56.458890 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:56.458858    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wlhwj_62da92f4-9217-4985-8aa2-c5db796fc211/discovery/0.log"
Jul 30 04:41:56.467969 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:56.467920    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fb6bd797-4fslr_b930714f-b7ee-4aa3-a830-1b3fc554a87a/kube-auth-proxy/0.log"
Jul 30 04:41:56.601630 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:56.601587    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8558776bb7-zts8f_90ba3f14-0f5d-4fb7-a723-774259f302e7/router/0.log"
Jul 30 04:41:58.180969 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:58.180931    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wlhwj_62da92f4-9217-4985-8aa2-c5db796fc211/discovery/0.log"
Jul 30 04:41:58.192256 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:58.192227    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fb6bd797-4fslr_b930714f-b7ee-4aa3-a830-1b3fc554a87a/kube-auth-proxy/0.log"
Jul 30 04:41:58.343757 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:41:58.343727    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8558776bb7-zts8f_90ba3f14-0f5d-4fb7-a723-774259f302e7/router/0.log"
Jul 30 04:42:00.934455 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:00.934426    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-mbkt6_f32fe676-c050-4287-aac7-119600a358b5/migrator/0.log"
Jul 30 04:42:00.953816 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:00.953785    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-mbkt6_f32fe676-c050-4287-aac7-119600a358b5/graceful-termination/0.log"
Jul 30 04:42:01.257442 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:01.257340    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv_77ba57ce-96dd-4028-b187-411bd28f7dc0/kube-storage-version-migrator-operator/1.log"
Jul 30 04:42:01.259116 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:01.259087    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-rtffv_77ba57ce-96dd-4028-b187-411bd28f7dc0/kube-storage-version-migrator-operator/0.log"
Jul 30 04:42:02.239694 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:02.239665    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tn52_b8bd7c8d-4721-4074-8231-5cd9d1f8f254/kube-multus-additional-cni-plugins/0.log"
Jul 30 04:42:02.258233 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:02.258201    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tn52_b8bd7c8d-4721-4074-8231-5cd9d1f8f254/egress-router-binary-copy/0.log"
Jul 30 04:42:02.276627 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:02.276597    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tn52_b8bd7c8d-4721-4074-8231-5cd9d1f8f254/cni-plugins/0.log"
Jul 30 04:42:02.293843 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:02.293810    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tn52_b8bd7c8d-4721-4074-8231-5cd9d1f8f254/bond-cni-plugin/0.log"
Jul 30 04:42:02.311784 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:02.311757    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tn52_b8bd7c8d-4721-4074-8231-5cd9d1f8f254/routeoverride-cni/0.log"
Jul 30 04:42:02.331581 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:02.331523    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tn52_b8bd7c8d-4721-4074-8231-5cd9d1f8f254/whereabouts-cni-bincopy/0.log"
Jul 30 04:42:02.350068 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:02.350041    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2tn52_b8bd7c8d-4721-4074-8231-5cd9d1f8f254/whereabouts-cni/0.log"
Jul 30 04:42:02.703930 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:02.703898    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zzb4g_fa3af588-c3d4-4a7e-a59e-6a17b155dcfe/kube-multus/0.log"
Jul 30 04:42:02.722618 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:02.722583    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9tdmg_b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359/network-metrics-daemon/0.log"
Jul 30 04:42:02.739423 ip-10-0-136-241 kubenswrapper[2571]: I0730 04:42:02.739387    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9tdmg_b47308dd-8fc9-44b8-b2e0-ca5cb6fa0359/kube-rbac-proxy/0.log"